Python Orchestration

Open-source Python projects categorized as Orchestration

Top 23 Python Orchestration Projects

Orchestration
  1. Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    Project mention: From Zero to Job Data Visualization vs Power BI: Which Wins? | dev.to | 2026-05-07

    For senior engineers building custom job data visualization pipelines, the single biggest latency gain comes from pre-aggregating frequently accessed metrics instead of running joins at query time. In our benchmarks, querying raw job_postings tables with 1M rows took 210ms average, while pre-aggregated tables (updated hourly via PostgreSQL materialized views) reduced query time to 12ms. Use tools like Apache Airflow 2.7.3 to schedule materialized view refreshes during off-peak hours. For example, a materialized view for average salary by company can be defined as:

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    Project mention: volnux VS Prefect - a user suggested alternative | libhunt.com/r/volnux | 2025-11-19
  4. serve

    ☁️ Build multimodal AI applications with cloud-native stack

  5. Taipy

    Turns Data and AI algorithms into production-ready web applications in no time.

  6. dagster

    An orchestration platform for the development, production, and observation of data assets.

    Project mention: Ten years late to the dbt party (DuckDB edition) | dev.to | 2026-02-23

    I used Dagster, which integrates with dbt nicely (see the point above about how it automagically pulls in documentation). It understands the models and dependencies, and orchestrates everything nicely. It tracks executions and shows you runtimes.

  7. agent-framework

    A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.

    Project mention: What We Learned Scanning Microsoft's Public Agent Framework Repository | dev.to | 2026-06-13

    Clear Code Intelligence scanned a public Microsoft repository: microsoft/agent-framework.

  8. Mage

    🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai

    Project mention: The Data Awakens: My First Pipeline with Mage AI | dev.to | 2025-09-11

    That’s where Mage AI stood out. From the very first try to run it , it feels really easy and straight forward .

  9. faraday

    Open Source Vulnerability Management Platform (by infobyte)

  10. tracecat

    Open-source security automation platform for teams and AI agents

    Project mention: N8n added native persistent storage with DataTables | news.ycombinator.com | 2025-10-02
  11. dstack

    Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

  12. kapitan

    Generic templated configuration management for Kubernetes, Terraform and other things

  13. dbos-transact-py

    Database-Backed Durable Python Workflows

    Project mention: Go-Native Durable Execution | news.ycombinator.com | 2026-03-02

    Automatic crash detection for your process is built-in our Conductor offering. The library has a default recovery mode when used standalone.

    What do you find strange with workflow versioning? Would love to consider improving the semantics. In fact, we started doing it: https://github.com/dbos-inc/dbos-transact-py/pull/598

  14. sdk-python

    Temporal Python SDK (by temporalio)

    Project mention: How Failing at Fantasy Baseball Made Me Fix My Cron Jobs with Temporal | dev.to | 2026-05-05

    Well, I’d been meaning to fix that setup anyway. This time I did — and instead of patching the script, I tried out Temporal and…it worked embarrassingly well. Retries, backoff, execution history — things I’d normally bolt on manually were just… there. And if the network layer itself was flaky — rate limits, geo blocks — I could just add a proxy as a hardening layer.

  15. covalent

    Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments. (by AgnostiqHQ)

  16. pipelex

    Declarative language for composable Al workflows. Devtool for agents and mere humans.

    Project mention: Show HN: Pipelex – declarative language for repeatable AI workflows (MIT) | news.ycombinator.com | 2025-10-28
  17. flintrock

    A command-line tool for launching Apache Spark clusters.

  18. fenic

    Declarative context engineering for agents

    Project mention: How to Build a Deep Research Agent with Pydantic AI | dev.to | 2025-11-17

    # Clone the example repo git clone https://github.com/typedef-ai/fenic-examples.git cd fenic-examples/hn_agent # Install dependencies with uv uv sync

  19. llama-agents

    Llama Agents + Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.

    Project mention: Show HN: Worflows.py, the best way to build agents | news.ycombinator.com | 2025-07-01
  20. k8s-bigip-ctlr

    Repository for F5 Container Ingress Services for Kubernetes & OpenShift.

  21. mcp-server-code-execution-mode

    An MCP server that executes Python code in isolated rootless containers with optional MCP server proxying. Implementation of Anthropic's and Cloudflare's ideas for reducing MCP tool definitions context bloat.

    Project mention: MCP Code Execution Server: Zero-Context Discovery for 100 MCP Tools | news.ycombinator.com | 2025-12-19
  22. omnicoreagent

    Open Python agent harness for production AI apps: tools, MCP, memory, workspace, telemetry, subagents, background tasks, and OmniServe APIs.

    Project mention: I Built OmniAgent: The Missing Bridge Between MCP and Custom Business Logic | news.ycombinator.com | 2025-08-08

    - Intelligent memory that learns your patterns

    GitHub: https://github.com/Abiorh001/mcp_omni_connect

  23. ops-examples

    A repository of basic and advanced examples using Ops

    Project mention: Unikernel Guide: Build and Deploy Lightweight, Secure Apps | news.ycombinator.com | 2025-08-02

    It doesn't necessarily mean that but yes you most definitely can run native images - another example showing that: https://github.com/nanovms/ops-examples/tree/master/java/07-... . Both of these pair very well with unikernels. Especially quarkus has excellent boot time and low mem usage.

  24. esdc-ce

    Danube Cloud :: Community Edition

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Orchestration discussion

Log in or Post with

Python Orchestration related posts

  • We Upgraded Airflow 2.8 to 3.1 on Kubernetes. Here Is What Actually Changed

    2 projects | dev.to | 6 May 2026
  • Show HN: Multi-agent coding assistant with a sandboxed Rust execution engine

    2 projects | news.ycombinator.com | 5 Apr 2026
  • Show HN: Lula – multi-agent coding assistant with sandboxed Rust exec engine

    1 project | news.ycombinator.com | 22 Mar 2026
  • How to Add a Kill Switch to Your AI Agent in 5 Minutes

    7 projects | dev.to | 21 Feb 2026
  • Show HN: FlowWatch – Decorator-first file watcher for Python workflows

    1 project | news.ycombinator.com | 21 Jan 2026
  • volnux VS Prefect - a user suggested alternative

    2 projects | 19 Nov 2025
  • N8n vs. Windmill vs. Temporal

    1 project | news.ycombinator.com | 12 Oct 2025
  • A note from our sponsor - SaaSHub
    www.saashub.com | 15 Jun 2026
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Orchestration projects in Python? This list will help you:

# Project Stars
1 Airflow 45,795
2 Prefect 22,581
3 serve 21,854
4 Taipy 19,237
5 dagster 15,661
6 agent-framework 11,283
7 Mage 8,749
8 faraday 6,518
9 tracecat 3,666
10 dstack 2,158
11 kapitan 1,914
12 dbos-transact-py 1,415
13 sdk-python 1,092
14 covalent 861
15 pipelex 682
16 flintrock 652
17 fenic 458
18 llama-agents 398
19 k8s-bigip-ctlr 395
20 mcp-server-code-execution-mode 334
21 omnicoreagent 242
22 ops-examples 141
23 esdc-ce 136

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Python is
the 1st most popular programming language
based on number of references?