Persistent Collection
A Persistent Java Collections Library (by hrldcpr)
Apache Orc
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads (by apache)
Our great sponsors
Persistent Collection | Apache Orc | |
---|---|---|
4 | 4 | |
746 | 654 | |
- | 0.9% | |
6.6 | 9.4 | |
about 1 month ago | 2 days ago | |
Java | Java | |
GNU General Public License v3.0 or later | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Persistent Collection
Posts with mentions or reviews of Persistent Collection.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-11.
-
I had a great experience with Scala and hopefully it will get more popular
So does Java! Also, kotlinx.collections is still not stable and I don't think they are intending to make it so any time soon.
-
What’s so great about functional programming anyway?
> If you are using containers, always, always, always use immutable containers from Google Guava unless you have an exceptionally good reason.
I actually prefer pcollections: https://github.com/hrldcpr/pcollections
AtomicReference + immutable data types is a really nice way to program in Java, and is basically the way most Clojure programs are written.
- Why Java's Records Are Better* Than Lombok's Data and Kotlin's Data Classes
-
Libraries, Frameworks and Technologies you would NOT recommend
You might consider persistent collections instead of immutable collections, I believe it is more optimized https://github.com/hrldcpr/pcollections
Apache Orc
Posts with mentions or reviews of Apache Orc.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-11-01.
-
Java Serialization with Protocol Buffers
The information can be stored in a database or as files, serialized in a standard format and with a schema agreed with your Data Engineering team. Depending on your information and requirements, it can be as simple as CSV, XML or JSON, or Big Data formats such as Parquet, Avro, ORC, Arrow, or message serialization formats like Protocol Buffers, FlatBuffers, MessagePack, Thrift, or Cap'n Proto.
- Personal data of 120,000 Russian servicemen fighting in Ukraine made public
-
AWS EMR Cost Optimization Guide
Data formatting is another place to make gains. When dealing with huge amounts of data, finding the data you need can take up a significant amount of your compute time. Apache Parquet and Apache ORC are columnar data formats optimized for analytics that pre-aggregate metadata about columns. If your EMR queries column intensive data like sum, max, or count, you can see significant speed improvements by reformatting data like CSVs into one of these columnar formats.
-
Apache Hudi - The Streaming Data Lake Platform
The following stack captures layers of software components that make up Hudi, with each layer depending on and drawing strength from the layer below. Typically, data lake users write data out once using an open file format like Apache Parquet/ORC stored on top of extremely scalable cloud storage or distributed file systems. Hudi provides a self-managing data plane to ingest, transform and manage this data, in a way that unlocks incremental data processing on them.
What are some alternatives?
When comparing Persistent Collection and Apache Orc you can also consider the following projects:
Big Queue - A big, fast and persistent queue based on memory mapped file.
Protobuf - Protocol Buffers - Google's data interchange format
tape - A lightning fast, transactional, file-based FIFO for Android and Java.
Apache Parquet - Apache Parquet
Apache Avro - Apache Avro is a data serialization system.
SBE - Simple Binary Encoding (SBE) - High Performance Message Codec
hudi - Upserts, Deletes And Incremental Processing on Big Data.
Apache Thrift - Apache Thrift
dexx - Persistent (immutable) collections for Java and Kotlin
Persistent Collection vs Big Queue
Apache Orc vs Protobuf
Persistent Collection vs tape
Apache Orc vs Apache Parquet
Persistent Collection vs Apache Parquet
Apache Orc vs Apache Avro
Persistent Collection vs SBE
Apache Orc vs hudi
Persistent Collection vs Protobuf
Apache Orc vs Apache Thrift
Persistent Collection vs dexx
Apache Orc vs tape