Scout APM is great for developers who want to find and fix performance issues in their applications. With Scout, we'll take care of the bugs so you can focus on building great things 🚀. Learn more →
Top 5 Python workflow-automation Projects
An orchestration platform for the development, production, and observation of data assets.Project mention: [D] Should I go with Prefect, Argo or Flyte for Model Training and ML workflow orchestration? | reddit.com/r/MachineLearning | 2022-09-26
You could also consider Dagster, which aims to improve Apache Airflow's shortcomings. Also, take a look at MyMLOps, where you can get a quick overview of open-source orchestration tools.
task management & automation toolProject mention: What is a good alternative to Makefile? | reddit.com/r/AskProgramming | 2022-07-07
I found these two https://pydoit.org/ and https://snakemake.readthedocs.io/en/stable/ but I am still looking for alternatives. Is there any more?
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Data Platform where developers build real-time applications for analytics, IoT and cloud-native services in less time with less code.
Obsei is a low code AI powered automation tool. It can be used in various business flows like social listening, AI based alerting, brand image analysis, comparative study and more .Project mention: Resources for social listening (preferably but not limited to Spanish) | reddit.com/r/LanguageTechnology | 2022-03-12
Hera is an Argo Workflows Python SDK. Hera aims to make workflow construction and submission easy and accessible to everyone! Hera abstracts away workflow setup details while still maintaining a consistent vocabulary with Argo Workflows.Project mention: New Argo Workflows Python SDK - Hera! | reddit.com/r/argoproj | 2021-12-02
Argo Labs now features Hera Workflows! Hera is a very simple Python library for constructing workflows - it can run any Python script you submit, allowing you and your company to focus on the value of the script itself rather than workflow construction :) you can run anything! ML workflows, DevOps jobs, crons with API calls, ETLs using pure Python, containers with commands, easily integrate with things like Horovod, etc.
Pythonic tool for running data-science/high performance/quantum-computing workflows in heterogenous environments. (by AgnostiqHQ)Project mention: Your strategies for offloading computation | reddit.com/r/Python | 2022-02-22
Came across this new tool exactly for this - https://github.com/AgnostiqHQ/covalent
Download talent.io’s Tech Salary Report. Median salaries, most in-demand technologies, state of the remote work... all you need to know your worth on the market by tech recruitment platform talent.io
Python workflow-automation related posts
ETL advice appreciated
1 project | reddit.com/r/ETL | 19 Jun 2022
Thinking of making a switch from actuarial science to data engineering
1 project | reddit.com/r/dataengineering | 15 Apr 2022
Developing in Dagster
2 projects | dev.to | 25 Mar 2022
Am I learning DE in a too roundabout way?
1 project | reddit.com/r/dataengineering | 24 Jan 2022
What is this kind of texture called?
1 project | reddit.com/r/Design | 19 Dec 2021
Airflow 2.0 vs Prefect
1 project | reddit.com/r/dataengineering | 20 Oct 2021
Runflow - define and run workflows using HCL2
1 project | reddit.com/r/datascience | 24 Jul 2021
A note from our sponsor - Scout APM
scoutapm.com | 2 Oct 2022
What are some of the best open-source workflow-automation projects in Python? This list will help you:
Are you hiring? Post a new remote job listing for free.