The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 Java Streaming Projects
-
Apache RocketMQ
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
seatunnel
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
-
Ant-Media-Server
Ant Media Server is a live streaming engine software that provides adaptive, ultra low latency streaming by using WebRTC technology with ~0.5 seconds latency. Ant Media Server is auto-scalable and it can run on-premise or on-cloud.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
LakeSoul
LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.
-
popcorn-android
Popcorn Time is a multi-platform, free software BitTorrent client that includes an integrated media player ( Android / AndroidTV ) A Butter-Project Fork
-
automq
A cloud native implementation for Apache Kafka, reducing your cloud infrastructure bill by up to 90%.
-
airy
💬 Open Source App Framework to build streaming apps with real-time data - 💎 Build real-time data pipelines and make real-time data universally accessible - 🤖 Join historical and real-time data in the stream to create smarter ML and AI applications. - ⚡ Standardize complex data ingestion and stream data to apps with pre-built connectors
-
firehose
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems. (by raystack)
-
sqrl
Compiler for streaming data pipelines and data microservices with configurable engines. (by DataSQRL)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Critical Analysis: Unraveling the Apache RocketMQ Remote Code Execution Vulnerability (CVE-2023-33246) | dev.to | 2023-07-29
Project mention: Choosing Between a Streaming Database and a Stream Processing Framework in Python | dev.to | 2024-02-10Stream-processing platforms such as Apache Kafka, Apache Pulsar, or Redpanda are specifically engineered to foster event-driven communication in a distributed system and they can be a great choice for developing loosely coupled applications. Stream processing platforms analyze data in motion, offering near-zero latency advantages. For example, consider an alert system for monitoring factory equipment. If a machine's temperature exceeds a certain threshold, a streaming platform can instantly trigger an alert and engineers do timely maintenance.
Project mention: Ask HN: Does (or why does) anyone use MapReduce anymore? | news.ycombinator.com | 2024-01-24The "streaming systems" book answers your question and more: https://www.oreilly.com/library/view/streaming-systems/97814.... It gives you a history of how batch processing started with MapReduce, and how attempts at scaling by moving towards streaming systems gave us all the subsequent frameworks (Spark, Beam, etc.).
As for the framework called MapReduce, it isn't used much, but its descendant https://beam.apache.org very much is. Nowadays people often use "map reduce" as a shorthand for whatever batch processing system they're building on top of.
Project mention: Advise on best way to implement video calling functionality into my web app | /r/webdev | 2023-06-07ant media server is the cheapest and has good documentation its also open source. it does the work for us https://github.com/ant-media/Ant-Media-Server/
Android.apk files here: https://github.com/popcorn-official/popcorn-android/releases Not as feature-rich as the desktop versions, though. Can be buggy - for some?
Project mention: Show HN: AutoMQ – A Cost-Effective Kafka distro that can autoscale in seconds | news.ycombinator.com | 2024-04-07Yes, thank you for the clarification. AutoMQ has replaced the topic-partition storage with cloud-native S3Stream (https://github.com/AutoMQ/automq/tree/main/s3stream) library, thereby harnessing the benefits of cloud EBS and S3.
If you're looking for a visual and more intuitive way to load data to Neo4j, you might want to have a look at Apache Hop. Hop comes with tons of functionality to load data to Neo4j.
Project mention: How do you solve data plumbing? Can we compile it away? | /r/dataengineering | 2023-10-20
Java Streaming related posts
- Choosing Between a Streaming Database and a Stream Processing Framework in Python
- How can I find my downloaded movies?
- How do you solve data plumbing? Can we compile it away?
- Help finding open source Terraform configurations that are not educational projects or developer tools
- Kafka Is Dead, Long Live Kafka
- Analyzing Real-Time Movie Reviews With Redpanda and Memgraph
- There are about Pulsar 10k users in Slack, but about 70 in this subreddit.
-
A note from our sponsor - WorkOS
workos.com | 19 Apr 2024
Index
What are some of the best open-source Streaming projects in Java? This list will help you:
Project | Stars | |
---|---|---|
1 | Apache RocketMQ | 20,522 |
2 | Logstash | 13,984 |
3 | Apache Pulsar | 13,727 |
4 | beam | 7,477 |
5 | seatunnel | 7,204 |
6 | Apache Storm | 6,532 |
7 | Ant-Media-Server | 4,087 |
8 | red5-server | 3,294 |
9 | LakeSoul | 2,294 |
10 | Pravega | 1,965 |
11 | popcorn-android | 1,188 |
12 | automq | 1,129 |
13 | kafka-connect-jdbc | 997 |
14 | TwitchRecover | 990 |
15 | hop | 850 |
16 | RadioDroid | 633 |
17 | airy | 360 |
18 | firehose | 312 |
19 | JsonSurfer | 286 |
20 | kafka-streams-in-action | 259 |
21 | riot | 225 |
22 | sqrl | 57 |
23 | roc-java | 20 |