Python workflow-automation

Open-source Python projects categorized as workflow-automation Edit details

Top 5 Python workflow-automation Projects

  • dagster

    An orchestration platform for the development, production, and observation of data assets.

    Project mention: [D] Should I go with Prefect, Argo or Flyte for Model Training and ML workflow orchestration? | reddit.com/r/MachineLearning | 2022-09-26

    You could also consider Dagster, which aims to improve Apache Airflow's shortcomings. Also, take a look at MyMLOps, where you can get a quick overview of open-source orchestration tools.

  • doit

    task management & automation tool

    Project mention: What is a good alternative to Makefile? | reddit.com/r/AskProgramming | 2022-07-07

    I found these two https://pydoit.org/ and https://snakemake.readthedocs.io/en/stable/ but I am still looking for alternatives. Is there any more?

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Data Platform where developers build real-time applications for analytics, IoT and cloud-native services in less time with less code.

  • obsei

    Obsei is a low code AI powered automation tool. It can be used in various business flows like social listening, AI based alerting, brand image analysis, comparative study and more .

    Project mention: Resources for social listening (preferably but not limited to Spanish) | reddit.com/r/LanguageTechnology | 2022-03-12
  • hera-workflows

    Hera is an Argo Workflows Python SDK. Hera aims to make workflow construction and submission easy and accessible to everyone! Hera abstracts away workflow setup details while still maintaining a consistent vocabulary with Argo Workflows.

    Project mention: New Argo Workflows Python SDK - Hera! | reddit.com/r/argoproj | 2021-12-02

    Argo Labs now features Hera Workflows! Hera is a very simple Python library for constructing workflows - it can run any Python script you submit, allowing you and your company to focus on the value of the script itself rather than workflow construction :) you can run anything! ML workflows, DevOps jobs, crons with API calls, ETLs using pure Python, containers with commands, easily integrate with things like Horovod, etc.

  • covalent

    Pythonic tool for running data-science/high performance/quantum-computing workflows in heterogenous environments. (by AgnostiqHQ)

    Project mention: Your strategies for offloading computation | reddit.com/r/Python | 2022-02-22

    Came across this new tool exactly for this - https://github.com/AgnostiqHQ/covalent

  • talent.io

    Download talent.io’s Tech Salary Report. Median salaries, most in-demand technologies, state of the remote work... all you need to know your worth on the market by tech recruitment platform talent.io

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-09-26.

Python workflow-automation related posts

Index

What are some of the best open-source workflow-automation projects in Python? This list will help you:

Project Stars
1 dagster 5,494
2 doit 1,469
3 obsei 727
4 hera-workflows 185
5 covalent 162
Find remote jobs at our new job board 99remotejobs.com. There are 8 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
Clean code begins in your IDE with SonarLint
Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
www.sonarlint.org