incubator-fury
FlatBuffers
incubator-fury | FlatBuffers | |
---|---|---|
15 | 48 | |
2,654 | 22,088 | |
3.4% | 0.7% | |
9.8 | 8.7 | |
4 days ago | 8 days ago | |
Java | C++ | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
incubator-fury
-
Rethinking string encoding: a 37.5% space efficient encoding than UTF-8 in Fury
For implemetation details, https://github.com/apache/incubator-fury/blob/main/java/fury... can be taken as an example
- Apache Fury – fast serialization framework – 0.5.0 released
- Fast Cloud Native Java Serialization:Fury JIT and GraalVM Native Image AOT
- Fury Serialization Framework 0.3.1 Released: Support Python 3.11&3.12
- Fury Serialization 0.3.1 Released: support Python 3.11&12
- Fury Serialization Framework 0.3.0 released
-
Fury Scala: Fast binary serialization for any Scala 2/3 objects
See https://github.com/alipay/fury/blob/main/docs/guide/scala_gu... for scala serialization user doc
- Fury – Fast multi-language serialization framework powered by JIT and Zero-copy
-
Fury: 170x faster than JDK, fast serialization powered by JIT and Zero-copy
Yes, Game is another scenario, it's very latency sensitive. Fury is very fast for such scenarios. Actually the java implememtation has been featured by some game developers. And there has always been a demand within the community for FURY to support C#: https://github.com/alipay/fury/issues/686 . I don't have experience for c#, so c# hasn't been support. We are still the community can join us for c# support.
- FLaNK Stack Weekly for 14 Aug 2023
FlatBuffers
- FlatBuffers – an efficient cross platform serialization library for many langs
-
Cap'n Proto 1.0
I don't work at Cloudflare but follow their work and occasionally work on performance sensitive projects.
If I had to guess, they looked at the landscape a bit like I do and regarded Cap'n Proto, flatbuffers, SBE, etc. as being in one category apart from other data formats like Avro, protobuf, and the like.
So once you're committed to record'ish shaped (rather than columnar like Parquet) data that has an upfront parse time of zero (nominally, there could be marshalling if you transmogrify the field values on read), the list gets pretty short.
https://capnproto.org/news/2014-06-17-capnproto-flatbuffers-... goes into some of the trade-offs here.
Cap'n Proto was originally made for https://sandstorm.io/. That work (which Kenton has presumably done at Cloudflare since he's been employed there) eventually turned into Cloudflare workers.
Another consideration: https://github.com/google/flatbuffers/issues/2#issuecomment-...
-
Anyone has experience with reverse engineering flatbuffers?
Much more in the discussion of this particular issue onGitHub: flatbuffers:Reverse engineering #4258
-
Flatty - flat message buffers with direct mapping to Rust types without packing/unpacking
Related but not Rust-specific: FlatBuffers, Cap'n Proto.
- flatbuffers - FlatBuffers: Memory Efficient Serialization Library
-
How do AAA studios make update-compatible save systems?
If json files are a concern because of space, you can always look into something like protobuffers or flatbuffers. But whatever you use, you should try to find a solution where you don't have to think about the actual serialization/deserialization of your objects, and can just concentrate on the data.
- QuickBuffers 1.1 released
-
Choosing a protocol for communication between multiple microcontrollers
Or, as an alternative to protobuffers, there's also flatbuffers, which is lighter weight and needs less memory: https://google.github.io/flatbuffers/
- FlatBuffers: FlatBuffers
-
Is using Flatbuffers to parse sensor data a bad application of Flatbuffers?
As the title suggests, I am considering using Flatbuffers as a way to parse sensor data that has been stored in local datafiles. The project language is python.
What are some alternatives?
jdbc-connector-for-apache-kafka - Aiven's JDBC Sink and Source Connectors for Apache Kafka®
Protobuf - Protocol Buffers - Google's data interchange format
grpc-dotnet - gRPC for .NET
MessagePack - MessagePack implementation for C and C++ / msgpack.org[C/C++]
fury-benchmarks - Serialization Benchmarks for fury with other libraries
MessagePack - MessagePack serializer implementation for Java / msgpack.org[Java]
MemoryPack - Zero encoding extreme performance binary serializer for C# and Unity.
Cap'n Proto - Cap'n Proto serialization/RPC system - core tools and C++ library
qs - Quick serialization of R objects
cereal - A C++11 library for serialization
feldera - Feldera Continuous Analytics Platform
Kryo - Java binary serialization and cloning: fast, efficient, automatic