Top 14 Python Dataflow Projects

Dataflow

• Add a project

1. pathway

   1 9 63,006 9.8 Python

   Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

   

   Project mention: GitHub's Fake Star Economy | news.ycombinator.com | 2026-04-20

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. marimo

   2 55 21,378 10.0 Python

   A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

   

   Project mention: Pluto.jl 1.0 release – reactive notebook for Julia | news.ycombinator.com | 2026-06-03

   Pluto is great. I use it all the time. If you like the reactivity/reproducibility but are wedded to Python, you might want to check out Marimo, which is also great. [https://marimo.io/]

   It too puts the output of a cell above the code so if you're unable to adapt to things that are different it's also probably not for you.

   FWIW, Observable's Notebooks (Javascript) work the same way: output above the code that produces it. [https://observablehq.com/]

   I too did not like having the output above the code but got over it pretty quickly. For plots, it's arguably better: usually, I want to see the plot before I see the 15 line invocation of some plot command. The thing that bugs me the most about Pluto now is that it really wants you to only have a single evaluating statement per cell. You have to wrap stuff in "block......end" if you want to e.g. define more than one variable in a cell.

4. pyt

   3 2 2,206 0.0 Python

   A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications

   

5. bytewax

   4 21 1,964 9.2 Python

   Python Stream Processing

   

   Project mention: Bytewax: Stream processing library built using Python and Rust | news.ycombinator.com | 2026-05-22

6. ipyflow

   5 23 1,268 8.8 Python

   A reactive Python kernel for Jupyter notebooks.

   

   Project mention: Representing Python notebooks as dataflow graphs | news.ycombinator.com | 2025-08-09

   Even with data flow extension (also like ipyflow [0] ) I am still struggling with the execution model of notebooks in general. I often still see people defining functions and classes in notebooks to somehow handle prototyping loops.

   I would love to see DAGs like in SSA form of compilers, that also supports loop operators. However, IMHO also the notebook interface needs to adjust for that (cell indentation ?). However, the strength of notebooks rather shows in document authoring like quarto, which IMHO mostly contradicts more complex controll flow.

   [0] https://github.com/ipyflow/ipyflow

7. pytm

   6 1 1,127 7.6 Python

   A Pythonic framework for threat modeling

   

8. finn

   7 4 1,007 2.7 Python

   Dataflow compiler for QNN inference on FPGAs

   

9. NIPY

   8 0 826 8.6 Python

   Workflows and interfaces for neuroimaging packages

   

10. prefect-deployment-patterns

    9 1 110 0.0 Python

    Code examples showing flow deployment to various types of infrastructure

    

11. entangle

    10 8 104 0.0 Python

    A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.

    

12. flowsaber

    11 2 41 0.0 Python

    Dataflow based workflow framework

    

13. krnel-graph

    12 1 22 9.3 Python

    Lightweight representation engineering dataflow operations for agent developers.

    

    Project mention: Show HN: Krnel-Graph", a Library For | news.ycombinator.com | 2025-11-03

14. pglineage

    13 1 17 8.2 Python

    pglineage is a tool to create data flow diagrams for PostgreSQL by analyzing SQL

    

15. m42pl-core

    14 1 4 0.0 Python

    A data manipulation language with a focus on flexibility and simplicity.

    

Python Dataflow related posts

• Show HN: Marimo pair – reactive Python notebooks as environments for agents

  11 projects | news.ycombinator.com | 7 Apr 2026

• Representing Python notebooks as dataflow graphs

  3 projects | news.ycombinator.com | 9 Aug 2025

• It's 2025: Your Python Toolbox Is More Than Just PyCharm

  3 projects | dev.to | 31 Jul 2025

• pathway VS cocoindex - a user suggested alternative

  2 projects | 1 Apr 2025

• Can anyone tell if Xilinx's FINN (from Xilinx's research lab) is restricted for use only to xilinx based FPGAs?

  2 projects | /r/FPGA | 8 Apr 2023

• flowsaber, a dataflow-based workflow package written in python

  1 project | /r/Python | 7 May 2021

• flowsaber, a dataflow-based workflow package written in python. It's extensible, and has a highly intuitive composing syntax, with native shell task support. The whole flows is linked and composed from channels and tasks, different runs of a task with different inputs will be scheduled and ran par

  1 project | /r/programming | 7 May 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 14 Jun 2026

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!