Python Orchestration

Open-source Python projects categorized as Orchestration

Top 23 Python Orchestration Projects

Orchestration
  1. Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    Project mention: How to Build an Open Lakehouse on Your Laptop | dev.to | 2026-10-01

    Everything so far ran because you typed it. Apache Airflow runs it on a schedule, retries it, and keeps a record of every run. It doesn't touch the data itself: its tasks talk to Spark through the same Connect server you've been using, so the Airflow image carries only the thin pyspark-client 4.2.0 (the version the Airflow 3.3.2 constraints pin, and the server's) and no JVM. The repo ships two DAGs:

  2. AppSignal

    Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

    AppSignal logo
  3. agents

    Multi-harness agentic plugin marketplace for Claude Code, Codex, Cursor, OpenCode, GitHub Copilot, Google Antigravity, and Pi

    Project mention: Skills Sprawl: When Too Much of a Good Thing Confuses Your AI Agent | dev.to | 2026-08-17

    Specialised & Community Skills: Niche skills sourced from specific community repositories, including wshobson/agents (documentation-and-adrs, interview-me), coreyhaines31/marketingskills (seo-audit), remotion-dev/skills (remotion-best-practices), and vercel-labs/skills (find-skills).

  4. haystack

    Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

    Project mention: haystack VS verified-memory-vault - a user suggested alternative | libhunt.com/r/haystack | 2026-08-25
  5. Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    Project mention: volnux VS Prefect - a user suggested alternative | libhunt.com/r/volnux | 2025-11-19
  6. serve

    ☁️ Build multimodal AI applications with cloud-native stack

  7. Taipy

    Turns Data and AI algorithms into production-ready web applications in no time.

  8. dagster

    An orchestration platform for the development, production, and observation of data assets.

    Project mention: Dagster: 1,712 Title Matches and a Zero Fingerprint | dev.to | 2026-09-29

    Dagster documentation and project: https://dagster.io/

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. agent-framework

    A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.

    Project mention: Microsoft Agent Framework behind a corporate proxy: the HTTP transport that ignored HTTPS_PROXY | dev.to | 2026-10-06

    That's what happened to me with the TypeSafe (Jev) connector in Microsoft Agent Framework. The fix was merged by the Microsoft team on October 6, 2026: microsoft/agent-framework#8984.

  11. Mage

    🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai

  12. faraday

    Open-source and AI-powered cybersecurity tools for offensive security, vulnerability management, and autonomous pentesting. Built by hackers in Latin America, used worldwide. (by infobyte)

  13. tracecat

    Open-source security automation platform for teams and AI agents

  14. dstack

    A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

  15. kapitan

    Generic templated configuration management for Kubernetes, Terraform and other things

  16. dbos-transact-py

    Database-Backed Durable Python Workflows

    Project mention: Go-Native Durable Execution | news.ycombinator.com | 2026-03-02

    Automatic crash detection for your process is built-in our Conductor offering. The library has a default recovery mode when used standalone.

    What do you find strange with workflow versioning? Would love to consider improving the semantics. In fact, we started doing it: https://github.com/dbos-inc/dbos-transact-py/pull/598

  17. sdk-python

    Temporal Python SDK (by temporalio)

    Project mention: How Failing at Fantasy Baseball Made Me Fix My Cron Jobs with Temporal | dev.to | 2026-05-05

    Well, I’d been meaning to fix that setup anyway. This time I did — and instead of patching the script, I tried out Temporal and…it worked embarrassingly well. Retries, backoff, execution history — things I’d normally bolt on manually were just… there. And if the network layer itself was flaky — rate limits, geo blocks — I could just add a proxy as a hardening layer.

  18. pipelex

    Build AI methods with your coding agent, then run them anywhere: as an MCP for chatbots, as a webapp for people, or via API for your software.

    Project mention: Show HN: Pipelex – declarative language for repeatable AI workflows (MIT) | news.ycombinator.com | 2025-10-28
  19. covalent

    Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments. (by AgnostiqHQ)

  20. flintrock

    A command-line tool for launching Apache Spark clusters.

  21. llama-agents

    Llama Agents + Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.

  22. k8s-bigip-ctlr

    Repository for F5 Container Ingress Services for Kubernetes & OpenShift.

  23. mcp-server-code-execution-mode

    An MCP server that executes Python code in isolated rootless containers with optional MCP server proxying. Implementation of Anthropic's and Cloudflare's ideas for reducing MCP tool definitions context bloat.

    Project mention: MCP Code Execution Server: Zero-Context Discovery for 100 MCP Tools | news.ycombinator.com | 2025-12-19
  24. omnicoreagent

    The governed runtime for Python agents you can let act: policy on every action, durable runs, sandboxes, budgets, and the evidence of every run.

  25. ops-examples

    A repository of basic and advanced examples using Ops

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Orchestration discussion

Log in or Post with

Python Orchestration related posts

  • Zero-Code OpenTelemetry Tracing for Dagster

    3 projects | dev.to | 21 Sep 2026
  • CISA Adds Seven Known Exploited Vulnerabilities to Catalog: AI Infrastructure, Python Web Frameworks, SonicWall, VoIP, and Artifactory

    3 projects | dev.to | 3 Sep 2026
  • haystack VS verified-memory-vault - a user suggested alternative

    2 projects | 25 Aug 2026
  • Dev log #17 From 16-bit TUIs to p2p Hardening: A 227-Commit Week

    7 projects | dev.to | 16 Aug 2026
  • Same agent tasks, 76% fewer LLM calls – we moved semantic cache inside the graph

    1 project | news.ycombinator.com | 12 Jul 2026
  • We Upgraded Airflow 2.8 to 3.1 on Kubernetes. Here Is What Actually Changed

    2 projects | dev.to | 6 May 2026
  • Show HN: Multi-agent coding assistant with a sandboxed Rust execution engine

    2 projects | news.ycombinator.com | 5 Apr 2026
  • A note from our sponsor - AppSignal
    www.appsignal.com | 9 Oct 2026
    APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product. Learn more →

Index

What are some of the best open-source Orchestration projects in Python? This list will help you:

# Project Stars
1 Airflow 47,047
2 agents 40,180
3 haystack 26,648
4 Prefect 23,989
5 serve 21,859
6 Taipy 19,439
7 dagster 16,248
8 agent-framework 13,913
9 Mage 8,829
10 faraday 6,764
11 tracecat 3,829
12 dstack 2,271
13 kapitan 1,929
14 dbos-transact-py 1,604
15 sdk-python 1,212
16 pipelex 933
17 covalent 868
18 flintrock 649
19 llama-agents 458
20 k8s-bigip-ctlr 401
21 mcp-server-code-execution-mode 340
22 omnicoreagent 250
23 ops-examples 146

Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com