Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 4 Java Batch Projects
-
seatunnel
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: Ask HN: Does (or why does) anyone use MapReduce anymore? | news.ycombinator.com | 2024-01-24The "streaming systems" book answers your question and more: https://www.oreilly.com/library/view/streaming-systems/97814.... It gives you a history of how batch processing started with MapReduce, and how attempts at scaling by moving towards streaming systems gave us all the subsequent frameworks (Spark, Beam, etc.).
As for the framework called MapReduce, it isn't used much, but its descendant https://beam.apache.org very much is. Nowadays people often use "map reduce" as a shorthand for whatever batch processing system they're building on top of.
Project mention: SeaTunnel – super high-performance, distributed data integration tool | news.ycombinator.com | 2024-04-28
https://www.graphql-java.com/documentation/batching/ https://github.com/graphql-java/java-dataloader
Java Batch related posts
-
Ask HN: Does (or why does) anyone use MapReduce anymore?
-
How do Streaming Aggregation Pipelines work?
-
Releasing Temporian, a Python library for processing temporal data, built together with Google
-
Kafka cluster loses or duplicates messages
-
Apache Beam
-
Composer out of resources - "INFO Task exited with return code Negsignal.SIGKILL"
-
Pub/Sub parallel processing best practices
-
A note from our sponsor - InfluxDB
www.influxdata.com | 1 May 2024
Index
What are some of the best open-source Batch projects in Java? This list will help you:
Project | Stars | |
---|---|---|
1 | beam | 7,519 |
2 | seatunnel | 7,223 |
3 | easy-batch | 600 |
4 | java-dataloader | 486 |
Sponsored