Java Flink

Open-source Java projects categorized as Flink
Edit details
Topics: Big Data Java Spark Python apache-flink
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Sponsored

Top 16 Java Flink Projects

    Project mention: First 15 Open Source Advent projects | dev.to | 2023-12-15

    7. Apache Flink | Github | tutorial

  • Zeppelin

    Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

    • Project mention: Serverless Apache Zeppelin on AWS | dev.to | 2024-02-04

    Now we can proceed with the definition of Apache Zeppelin. It is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with Python, Scala, SQL, Spark, and more. You can execute code and even schedule a job (via cron) to run at regular intervals.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • LakeSoul

    LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

  • paimon

    Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

    • Project mention: Open Source Advent Fun Wraps Up! | dev.to | 2024-01-05

    18. Apache Paimon | Github | tutorial

  • SREWorks

    Cloud Native DataOps & AIOps Platform | 云原生数智运维平台

  • bitsail

    BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.

  • yauaa

    Yet Another UserAgent Analyzer

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
    • Project mention: Top 10 Common Data Engineers and Scientists Pain Points in 2024 | dev.to | 2024-04-11

    Data scientists often prefer Python for its simplicity and powerful libraries like Pandas or SciPy. However, many real-time data processing tools are Java-based. Take the example of Kafka, Flink, or Spark streaming. While these tools have their Python API/wrapper libraries, they introduce increased latency, and data scientists need to manage dependencies for both Python and JVM environments. For example, implementing a real-time anomaly detection model in Kafka Streams would require translating Python code into Java, slowing down pipeline performance, and requiring a complex initial setup.

    Project mention: Auto-Synchronizing an Entire MySQL Database for Data Analysis | dev.to | 2023-09-01

    Download JAR file: https://github.com/apache/doris-flink-connector/releases/tag/1.4.0

  • hadoopcryptoledger

    Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

    • Project mention: FLaNK AI Weekly 18 March 2024 | dev.to | 2024-03-18

  • scotty-window-processor

    This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.

    • Project mention: Implementing a “Lookback” Window Using Apache Flink’s KeyedProcessFunction | /r/RedditEng | 2023-10-10

    This concept is similar to a sliding window with a small step size, but with a more memory-efficient implementation. By using “slice sharing” instead of duplicating events into every overlapping window, the memory footprint is reduced. Scotty window processor is an open-source implementation of memory-efficient window aggregations with connectors for popular stream processors like Flink. This is a promising avenue for approximating a “lookback” window when aggregations like count, sum or histogram are required.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-04-11.

Java Flink related posts

Index

What are some of the best open-source Flink projects in Java? This list will help you:

Project Stars
1 Apache Flink 23,128
2 Zeppelin 6,261
3 LakeSoul 2,294
4 paimon 1,792
5 SREWorks 1,693
6 bitsail 1,575
7 yauaa 726
8 flink-kubernetes-operator 711
9 flink-ml 288
10 doris-flink-connector 276
11 flink-faker 194
12 flink-remote-shuffle 189
13 hadoopcryptoledger 142
14 flink-http-connector 118
15 scotty-window-processor 75
16 cratedb-flink-jobs 2

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com