Persistent Collection
Apache Avro
Our great sponsors
Persistent Collection | Apache Avro | |
---|---|---|
4 | 22 | |
745 | 2,744 | |
- | 1.9% | |
6.6 | 9.7 | |
12 days ago | 1 day ago | |
Java | Java | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Persistent Collection
-
I had a great experience with Scala and hopefully it will get more popular
So does Java! Also, kotlinx.collections is still not stable and I don't think they are intending to make it so any time soon.
-
What’s so great about functional programming anyway?
> If you are using containers, always, always, always use immutable containers from Google Guava unless you have an exceptionally good reason.
I actually prefer pcollections: https://github.com/hrldcpr/pcollections
AtomicReference + immutable data types is a really nice way to program in Java, and is basically the way most Clojure programs are written.
- Why Java's Records Are Better* Than Lombok's Data and Kotlin's Data Classes
-
Libraries, Frameworks and Technologies you would NOT recommend
You might consider persistent collections instead of immutable collections, I believe it is more optimized https://github.com/hrldcpr/pcollections
Apache Avro
-
Generating Avro Schemas from Go types
The most common format for describing schema in this scenario is Apache Avro.
- The state of Apache Avro in Rust
- How people generate examples for multiple programming languages?
-
gRPC on the client side
Other serialization alternatives have a schema validation option: e.g., Avro, Kryo and Protocol Buffers. Interestingly enough, gRPC uses Protobuf to offer RPC across distributed components:
-
Understanding Azure Event Hubs Capture
Apache Avro is a data serialization system, for more information visit Apache Avro
-
In One Minute : Hadoop
Avro, a data serialization system based on JSON schemas.
- Protocol Buffer x JSON para serialização de dados
-
Marshaling objects in modern Java
If binary format is OK, use Protocol Buffer or Avro . Note that in the case of binary formats, you need a schema to serialize/de-serialize your data. Therefore, you'd probably want a schema registry to store all past and present schemas for later usage.
-
How-to-Guide: Contributing to Open Source
Apache Avro
-
How should I handle storing and reading from large amounts of data in my project?
Maybe it will be simpler to serialise all the data in a more compact data format, such as avro (its readme is in here), a row based format that seems to be able to use zstd/bzip/xz.
What are some alternatives?
Protobuf - Protocol Buffers - Google's data interchange format
SBE - Simple Binary Encoding (SBE) - High Performance Message Codec
Big Queue - A big, fast and persistent queue based on memory mapped file.
Apache Thrift - Apache Thrift
iceberg - Apache Iceberg
Apache Parquet - Apache Parquet
gRPC - The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)
Apache Orc - Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
hudi - Upserts, Deletes And Incremental Processing on Big Data.
tape - A lightning fast, transactional, file-based FIFO for Android and Java.
Wire - gRPC and protocol buffers for Android, Kotlin, Swift and Java.