Python Orchestration

Open-source Python projects categorized as Orchestration
Edit details
Topics: #Python #Data Science #Workflow #Automation #DevOps
Write Clean Python Code. Always.
Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
www.sonarsource.com
Sponsored

Top 14 Python Orchestration Projects

  • Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    Project mention: self hosted Alternative to easycron.com? | reddit.com/r/selfhosted | 2022-12-30

  • dagster

    An orchestration platform for the development, production, and observation of data assets.

    Project mention: dbt Cloud Alternatives? | reddit.com/r/dataengineering | 2023-01-23

    Dagster? https://dagster.io

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • faraday

    Open Source Vulnerability Management Platform (by infobyte)

    Project mention: Penetration Testing Report | reddit.com/r/Pentesting | 2022-12-20

    or you can also use our open source version: https://github.com/infobyte/faraday

  • kapitan

    Generic templated configuration management for Kubernetes, Terraform and other things

  • WALKOFF

    A flexible, easy to use, automation framework allowing users to integrate their capabilities and devices to cut through the repetitive, tedious tasks slowing them down. #nsacyber

  • flintrock

    A command-line tool for launching Apache Spark clusters.

  • bodywork

    ML pipeline orchestration and model deployments on Kubernetes, made really easy.

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.

  • covalent

    Pythonic tool for running data-science/high performance/quantum-computing workflows in heterogenous environments. (by AgnostiqHQ)

    Project mention: Show HN: Covalent – distributed computing for ML, HPC and Quantum (open source) | news.ycombinator.com | 2022-11-09

  • cadence-python

    Python framework for Cadence Workflow Service

  • esdc-ce

    Danube Cloud :: Community Edition

    Project mention: Smartos | reddit.com/r/smartos | 2023-01-31

  • prefect-deployment-patterns

    Code examples showing flow deployment to various types of infrastructure

    Project mention: [D] Should I go with Prefect, Argo or Flyte for Model Training and ML workflow orchestration? | reddit.com/r/MachineLearning | 2022-09-26

    Have you used infrastructure blocks in Prefect? You could easily build a block for Sagemaker deploying infrastructure for the flow running with GPUs, then run other flow in a local process, yet another one as Kubernetes job, Docker container, ECS task, AWS batch, etc. Super easy to set up, even from the UI or from CI/CD. There are a bunch of templates and examples here: https://github.com/anna-geller/prefect-deployment-patterns

  • paco

    Paco: Prescribed automation for cloud orchestration (by waterbear-cloud)

  • blueprint-examples

    This is where you can find officially supported Cloudify blueprints that work with the latest versions of Cloudify. Please make sure to use the blueprints from this repo when you are evaluating Cloudify.

    Project mention: run-exec ansible scripts after provisioning of all | reddit.com/r/Terraform | 2022-09-07

    Note specifically the following snippet from the aws.yaml file.

  • py-inventa

    A Python library for microservice registry and executing RPC (Remote Procedure Call) over Redis.

    Project mention: Inventa - A Go and Python library for microservice registry and executing RPC over Redis | reddit.com/r/golang | 2022-07-30

    - Inventa for Python: https://github.com/adalkiran/py-inventa - https://pypi.org/project/inventa

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-01-31.

Python Orchestration related posts

Index

What are some of the best open-source Orchestration projects in Python? This list will help you:

Project Stars
1 Prefect 11,233
2 dagster 6,426
3 faraday 3,684
4 kapitan 1,625
5 WALKOFF 1,130
6 flintrock 616
7 bodywork 413
8 covalent 267
9 cadence-python 140
10 esdc-ce 101
11 prefect-deployment-patterns 51
12 paco 31
13 blueprint-examples 24
14 py-inventa 6

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com