Java Stream Processing

Open-source Java projects categorized as Stream Processing | Edit details

Top 9 Java Stream Processing Projects

  • Hazelcast

    Open-source distributed computation and storage platform

    Project mention: Show HN: Hazelcast 5 BETA – streaming+storage in one | | 2021-07-16
  • hudi

    Upserts, Deletes And Incremental Processing on Big Data.

    Project mention: Apache Hudi and Glue Catalog | | 2021-11-01

    Found this very similar discussion, differing only in that it's EMR which is what Glue is in the background anyway. Logs attached in the discussion are showing an error thrown by Glue when Hudi tries to perform an ALTER TABLE CASCADE because Glue metastore doesn't support cascade. The linked Jira in the discussion claims that more recent EMR versions resolve this issue but there are comments as of May this year claiming it's still unresolved. It's unclear to me which EMR version Glue 2.0 uses. I'll dig into this tomorrow and also try with Glue 3.0 as that may use a more recent version of EMR that's resolved the issue.

  • SonarLint

    Deliver Cleaner and Safer Code - Right in Your IDE of Choice!. SonarLint is a free and open source IDE extension that identifies and catches bugs and vulnerabilities as you code, directly in the IDE. Install from your favorite IDE marketplace today.

  • Siddhi

    Stream Processing and Complex Event Processing Engine

  • Hazelcast Jet

    Distributed Stream and Batch Processing

    Project mention: Updating data files, commits vs. pull requests | | 2021-08-15

    Hazelcast Jet

  • spring-cloud-dataflow

    A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

    Project mention: Large-Scale Automated Source Code Refactoring with OpenRewrite | | 2021-08-13

    It's also incredibly tedious when you do set about modernizing it. Fixing these things is more possible than you would initially think. Sometimes, we can get an app _almost_ all the way there, with just a little left to do:

  • Smooks

    Extensible data integration Java framework for building XML and non-XML fragment-based applications

  • kafka-streams-in-action

    Source code for the Kafka Streams in Action Book

    Project mention: Unable to run Kafka Streaming App using IntelliJ in Macbook Pro M1 | | 2021-04-17

    I have started Zookeeper and Kafka in separate terminals (Not in IDE Terminals) and I m able to send and receive messages from Kafka console. I have downloaded repo and am trying to run basic chapters and even tried creating a sample kafka streaming app as well. When I m starting the app, I m getting the following error:

  • OPS

    OPS - Build and Run Open Source Unikernels. Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.

  • RemoteCodeCompiler

    An online code compiler using Java and Docker for Java, C, C++, and Python for competitive programming and coding interviews

    Project mention: Create a Platform like LeetCode | | 2021-12-03
  • Event-Meshinery

    A new Framework for asynchronous signaling of processes via Kafka/Mysql/anything.

    Project mention: How many different groups/consumers for X topics? | | 2021-12-12

    If you are interested here is the project. Iam close to releasing a first version of this, but i stumbled upon this kafka problem.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-12-12.

Java Stream Processing related posts


What are some of the best open-source Stream Processing projects in Java? This list will help you:

Project Stars
1 Hazelcast 4,701
2 hudi 2,702
3 Siddhi 1,300
4 Hazelcast Jet 965
5 spring-cloud-dataflow 840
6 Smooks 332
7 kafka-streams-in-action 205
8 RemoteCodeCompiler 40
9 Event-Meshinery 1
Find remote jobs at our new job board There are 29 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
Less time debugging, more time building
Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.