jvm-serializers
incubator-fury
jvm-serializers | incubator-fury | |
---|---|---|
7 | 15 | |
3,277 | 2,669 | |
- | 3.9% | |
4.4 | 9.8 | |
8 months ago | 5 days ago | |
Java | Java | |
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jvm-serializers
-
Fury: 170x faster than JDK, fast serialization powered by JIT and Zero-copy
Compared with protobuf, fury is 3.2x faster. When comparing with avro, fury is 5.3x faster. Compared with flatbuffers, fury is 4.8x faster. See https://github.com/eishay/jvm-serializers/wiki for detailed benchmark data
-
The state of Java Object Serialization libraries in Q2 2023
First, there's benchmarks here if you haven't seen it: jvm-serializers. Not terribly scientific, but it's something. To make any decision, you really need to benchmark your own object graph and it's important to configure the serializer for your particular usage. Still, it is sort of useful for comparing frameworks. It would be interesting to see how Loial performs there. Ping me if you add it.
-
Up to 100x Faster FastAPI with simdjson and io_uring on Linux 5.19+
It depends. Some binary encodings such as flatbuffer are actually slower than some JSON libraries. There's a wide range of performance even in the JSON libraries themselves. Generally the faster JSON libraries are the ones that work on a predefined schema and so are able to generate code specifically for that JSON.
-
Go standard library: structured, leveled logging
> I'm surprised this is up for debate.
I looked into logging in protobuf when I was seeing if there was a better binary encoding for ring-buffer logging, along the same lines as nanolog:
https://tersesystems.com/blog/2020/11/26/queryable-logging-w...
What I found was that it's typically not the binary encoding vs string encoding that makes a difference. The biggest factors are "is there a predefined schema", "is there a precompiler that will generate code for this schema", and "what is the complexity of the output format". With that in mind, if you are dealing with chaotic semi-structured data, JSON is pretty good, and actually faster than some binary encodings:
https://github.com/eishay/jvm-serializers/wiki/Newer-Results...
-
Scala 3.0 serialization
You could use any of the JVM serialisers which should still work.
incubator-fury
-
Rethinking string encoding: a 37.5% space efficient encoding than UTF-8 in Fury
For implemetation details, https://github.com/apache/incubator-fury/blob/main/java/fury... can be taken as an example
- Apache Fury – fast serialization framework – 0.5.0 released
- Fast Cloud Native Java Serialization:Fury JIT and GraalVM Native Image AOT
- Fury Serialization Framework 0.3.1 Released: Support Python 3.11&3.12
- Fury Serialization 0.3.1 Released: support Python 3.11&12
- Fury Serialization Framework 0.3.0 released
-
Fury Scala: Fast binary serialization for any Scala 2/3 objects
See https://github.com/alipay/fury/blob/main/docs/guide/scala_gu... for scala serialization user doc
- Fury – Fast multi-language serialization framework powered by JIT and Zero-copy
-
Fury: 170x faster than JDK, fast serialization powered by JIT and Zero-copy
Yes, Game is another scenario, it's very latency sensitive. Fury is very fast for such scenarios. Actually the java implememtation has been featured by some game developers. And there has always been a demand within the community for FURY to support C#: https://github.com/alipay/fury/issues/686 . I don't have experience for c#, so c# hasn't been support. We are still the community can join us for c# support.
- FLaNK Stack Weekly for 14 Aug 2023
What are some alternatives?
fury-benchmarks - Serialization Benchmarks for fury with other libraries
jdbc-connector-for-apache-kafka - Aiven's JDBC Sink and Source Connectors for Apache Kafka®
Apache Avro - Apache Avro is a data serialization system.
grpc-dotnet - gRPC for .NET
zio-json - Fast, secure JSON library with tight ZIO integration.
opentelemetry-specificatio
MemoryPack - Zero encoding extreme performance binary serializer for C# and Unity.
janino - Janino is a super-small, super-fast Java™ compiler.
FlatBuffers - FlatBuffers: Memory Efficient Serialization Library
qs - Quick serialization of R objects