Java Stream Processing

Open-source Java projects categorized as Stream Processing
Edit details
Topics: Java Kafka Big Data Real-time Distributed Applications
The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
Sponsored

Top 14 Java Stream Processing Projects

  • Hazelcast

    Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

    • Project mention: Does anyone know any good java implementations for distributed key-value store? | /r/ExperiencedDevs | 2023-06-08

    You're probably looking for Hazelcast here. Note that it does much more than just a distributed k/v, but it will get you where you need to go.

  • ksql

    The database purpose-built for stream processing applications.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • hudi

    Upserts, Deletes And Incremental Processing on Big Data.

    • Project mention: Getting Started with Flink SQL, Apache Iceberg and DynamoDB Catalog | dev.to | 2023-12-18

    Apache Iceberg is one of the three types of lakehouse, the other two are Apache Hudi and Delta Lake.

  • Siddhi

    Stream Processing and Complex Event Processing Engine

  • Hazelcast Jet

    Distributed Stream and Batch Processing

  • spring-cloud-dataflow

    A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

  • Smooks

    Extensible data integration Java framework for building XML and non-XML fragment-based applications

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • kafka-streams-in-action

    Source code for the Kafka Streams in Action Book

  • dagger

    Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data. (by raystack)

  • RemoteCodeCompiler

    An online code compiler supporting 11 programming languages (Java, Kotlin, Scala, C, C++, C#, Golang, Python, Ruby, Rust and Haskell) for competitive programming and coding interviews.

  • scotty-window-processor

    This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.

    • Project mention: Implementing a “Lookback” Window Using Apache Flink’s KeyedProcessFunction | /r/RedditEng | 2023-10-10

    This concept is similar to a sliding window with a small step size, but with a more memory-efficient implementation. By using “slice sharing” instead of duplicating events into every overlapping window, the memory footprint is reduced. Scotty window processor is an open-source implementation of memory-efficient window aggregations with connectors for popular stream processors like Flink. This is a promising avenue for approximating a “lookback” window when aggregations like count, sum or histogram are required.

  • hash4j

    Dynatrace hash library for Java

  • kafka-streams-cassandra-state-store

    'Drop-in' Kafka Streams State Store implementation that persists data to Apache Cassandra / ScyllaDB

    • Project mention: Finished!! Live-Coding series on implementing ‘VersionedKeyValueStore’ for ‘kafka-streams-cassandra-state-store’ | /r/apachekafka | 2023-08-22

    The PR is ready. Feel welcome to review: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/27

  • Event-Meshinery

    A new Framework for asynchronous signaling of processes via Kafka/Mysql/anything.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Java Stream Processing related posts

Index

What are some of the best open-source Stream Processing projects in Java? This list will help you:

Project Stars
1 Hazelcast 5,861
2 ksql 5,811
3 hudi 5,053
4 Siddhi 1,499
5 Hazelcast Jet 1,090
6 spring-cloud-dataflow 1,066
7 Smooks 384
8 kafka-streams-in-action 259
9 dagger 254
10 RemoteCodeCompiler 130
11 scotty-window-processor 75
12 hash4j 75
13 kafka-streams-cassandra-state-store 20
14 Event-Meshinery 8

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com