Top 6 Python workflow-management Projects

workflow-management

• Add a project

1. snakemake

   1 2 2,509 9.7 Python

   This is the development home of the workflow management system Snakemake. For general information, see

   

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. doit

   2 20 1,941 0.0 Python

   CLI task management & automation tool

   

4. couler

   3 1 937 4.1 Python

   Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

   

5. covalent

   4 4 835 7.1 Python

   Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments. (by AgnostiqHQ)

   

6. hera

   5 2 739 9.1 Python

   Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Workflows entirely in Python. ⭐️ Remember to star!

   

   Project mention: Migrating CI/CD from Jenkins to Argo | dev.to | 2024-09-17

   Finally, not everybody on the Pipekit team was familiar with Groovy and writing Jenkins pipelines. So, it helped to have a tool that we could write with YAML. Also, Python developers could use the Hera SDK to spin up CI.

7. pneumaticworkflow

   6 1 241 7.6 Python

   Free and source-available Apache 2.0 licensed lightweight workflow automation tool.

   

   Project mention: Show HN: Pneumatic – free open-source workflow software | news.ycombinator.com | 2024-10-24

Python workflow-management related posts

• The Yoga of Image Generation – Part 1

  6 projects | dev.to | 11 Feb 2025

• Migrating CI/CD from Jenkins to Argo

  2 projects | dev.to | 17 Sep 2024

• Prefect alternatives meant for Slurm (HPC)

  1 project | /r/dataengineering | 11 Jun 2023

• Show HN: Covalent – distributed computing for ML, HPC and Quantum (open source)

  1 project | news.ycombinator.com | 9 Nov 2022

Index

Sponsored

InfluxDB – Built for High-Performance Time Series Workloads

InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

www.influxdata.com

Do not miss the trending Python projects with our weekly report!