Top 10 Python Dataflow Projects

pyt

2 2,161 0.0 Python

A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications
bytewax

18 1,144 9.8 Python

Python Stream Processing

Project mention: Building a streaming SQL engine with Arrow and DataFusion | news.ycombinator.com | 2024-03-18

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
ipyflow

20 1,073 9.5 Python

A reactive Python kernel for Jupyter notebooks.

Project mention: Show HN: Marimo – an open-source reactive notebook for Python | news.ycombinator.com | 2024-01-12

You're probably referring to nbgather (https://github.com/microsoft/gather), which shipped with VSCode for a while.
nbgather used static slicing to get all the code necessary to reconstruct some cell. I actually worked with Andrew Head (original nbgather author) and Shreya Shankar to implement something similar in ipyflow (but with dynamic slicing and a not-as-nice interface): https://github.com/ipyflow/ipyflow?tab=readme-ov-file#state-...
I have no doubt something like this will make its way into marimo's roadmap at some point :)

pytm

1 836 6.9 Python

A Pythonic framework for threat modeling
NIPY

0 731 8.9 Python

Workflows and interfaces for neuroimaging packages
finn

4 661 0.0 Python

Dataflow compiler for QNN inference on FPGAs

Project mention: Hi, What could be the best HLS tool for implementing neural networks on FPGA | /r/FPGA | 2023-06-13

FINN - https://github.com/Xilinx/finn

entangle

8 105 0.0 Python

A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
prefect-deployment-patterns

1 93 0.0 Python

Code examples showing flow deployment to various types of infrastructure
flowsaber

2 40 0.0 Python

Dataflow based workflow framework
m42pl-core

1 4 0.0 Python

A data manipulation language with a focus on flexibility and simplicity.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).