SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python Workflow Projects
-
Hi HN,
We've built an SDK for building DAGs / data pipelines with LLMs in Apache Airflow [1] using Pydantic AI [2] under the hood. I've seen success across the board with Airflow users building simple LLM workflows before moving on to "AI agents". In my experience, the noise around building agents means that people forget that there are other ways to get more immediate value out of LLMs.
Coupling Airflow for orchestration and Pydantic AI for LLM interactions has turned out to be a very pragmatic approach to building these workflows (and agents). Neither tool "gets in the way" of what you're trying to do. Airflow's been around for 10+ years and has a very well-built orchestration engine rich with everything you need to write production grade data pipelines, and Pydantic AI's been a refreshing take on working with LLMs.
Would love some feedback from this community!
[1] https://github.com/apache/airflow
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
Project mention: Show HN: Flow – A Dynamic Task Engine for AI Agents Without DAG | news.ycombinator.com | 2024-12-02
- https://github.com/PrefectHQ/prefect
-
Project mention: Top 40 Open-source Developer Tools with the Most GitHub Stars | dev.to | 2025-04-20
GitHub: https://github.com/Avaiga/taipy
-
Project mention: Show HN: MCP Server to let agents control the browser | news.ycombinator.com | 2025-04-03
Hey HN, we were playing around with MCPs over the weekend and thought it would be cool to build an MCP that lets Claude / Cursor / Windsurf control your browser: https://github.com/Skyvern-AI/skyvern/tree/main/integrations...
Just for context, we’re building Skyvern, an open source AI Agent that can control and interact with browsers using prompts, similar to OpenAI’s Operator.
The MCP Server can:
- This allows Claude to navigate to docs websites / stack overflow and look up information like the top posts on hackernews
-
-
Project mention: Say Hello to UV: A Fast Python Package & Project Manager Written in Rust | dev.to | 2025-04-17
If you’ve been managing Python projects long enough, you’ve probably dealt with a mess of tools: pip, pip-tools, poetry, virtualenv, conda, maybe even pdm.
-
Seamless integration: Works with OCI-compliant registries (e.g., Docker Hub and Jozu Hub) and integrates with popular tools like HuggingFace, ZenML, and Git.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
-
-
index
The SOTA Open-Source Browser Agent for autonomously performing complex tasks on the web (by lmnr-ai)
Project mention: Show HN: Index – new SOTA Open Source browser agent | news.ycombinator.com | 2025-04-23right now package only supports models from gemini, anthropic and openai. Vision is required. PRs are very welcome! It's very easy to add new model, simply follow any providers in here https://github.com/lmnr-ai/index/tree/main/index/llm/provide...
-
Project mention: DocETL – open-source framework for complex document processing pipelines | news.ycombinator.com | 2024-10-21
-
-
-
-
comfyui_LLM_party
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, kimi,doubao. Adapted to local llms, vlm, gguf such as llama-3.3 Janus-Pro, Linkage graphRAG
Project mention: Comfyui_LLM_party: LLM Agent Framework in ComfyUI | news.ycombinator.com | 2024-11-26 -
mlrun
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
-
-
-
Project mention: Show HN: Flow – A Dynamic Task Engine for AI Agents Without DAG | news.ycombinator.com | 2024-12-02
- https://github.com/PrefectHQ/ControlFlow
Motivated by more or less the same frustration you've laid out here.
-
obsei
Obsei is a low code AI powered automation tool. It can be used in various business flows like social listening, AI based alerting, brand image analysis, comparative study and more .
-
gh-action-pypi-publish
The blessed :octocat: GitHub Action, for publishing your :package: distribution files to PyPI, the tokenless way: https://github.com/marketplace/actions/pypi-publish
Project mention: Popular GitHub Action tj-actions/changed-files is compromised | news.ycombinator.com | 2025-03-14I've always felt uncomfortable adding other people's actions to my GitHub workflows, and this is exactly the kind of thing I was worried about.
I tend to stick to the official GitHub ones (actions/setup-python etc) plus the https://github.com/pypa/gh-action-pypi-publish one because I trust the maintainers to have good security habits.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python Workflow discussion
Python Workflow related posts
-
How to Get Daily GitHub Follower Updates via Email (No Coding Needed!)
-
How to Get Daily GitHub Follower Updates via Email - No Coding Needed! Easy Setup Tutorial in 2025
-
Personal Picks: Data Product News (March 19, 2025)
-
Data Orchestration Tool Analysis: Airflow, Dagster, Flyte
-
Show HN: Flow – A Dynamic Task Engine for AI Agents Without DAG
-
PyPI now supports digital attestations
-
Monolith to Microservices: Should I Migrate and How?
-
A note from our sponsor - SaaSHub
www.saashub.com | 14 May 2025
Index
What are some of the best open-source Workflow projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | Airflow | 39,973 |
| 2 | Prefect | 19,241 |
| 3 | Taipy | 18,071 |
| 4 | skyvern | 13,275 |
| 5 | dagster | 13,107 |
| 6 | PDM | 8,370 |
| 7 | zenml | 4,571 |
| 8 | polyaxon | 3,634 |
| 9 | ploomber | 3,569 |
| 10 | octoDNS | 3,345 |
| 11 | viewflow | 2,774 |
| 12 | index | 2,114 |
| 13 | docetl | 1,947 |
| 14 | doit | 1,930 |
| 15 | Spiff | 1,760 |
| 16 | airflow-maintenance-dags | 1,721 |
| 17 | comfyui_LLM_party | 1,669 |
| 18 | mlrun | 1,522 |
| 19 | galaxy | 1,489 |
| 20 | Sooty | 1,395 |
| 21 | ControlFlow | 1,291 |
| 22 | obsei | 1,268 |
| 23 | gh-action-pypi-publish | 1,027 |
Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com