toil
common-workflow-language
toil | common-workflow-language | |
---|---|---|
2 | 6 | |
870 | 1,440 | |
0.3% | 0.4% | |
9.2 | 1.1 | |
3 days ago | 5 months ago | |
Python | Common Workflow Language | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
toil
-
Show HN: Hatchet – Open-source distributed task queue
a little late now, but I wonder if https://github.com/DataBiosphere/toil might meet your requirements
- Lessons Learned from Running Apache Airflow at Scale
common-workflow-language
-
Nextflow: Data-Driven Computational Pipelines
https://www.commonwl.org/
https://github.com/common-workflow-language/common-workflow-...
- Common Workflow Language (CWL)
- Are there any good resources for building data pipelines?
- Common Workflow Language
-
Kestra - Open-Source Airflow Alternative
And we can add it to the ever-growing list of existing workflow frameworks; https://github.com/common-workflow-language/common-workflow-language/wiki/Existing-Workflow-systems
What are some alternatives?
luigi - Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
kestra - Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
direktiv - Serverless Container Orchestration
nextflow - A DSL for data-driven computational pipelines
windmill - Open-source developer platform to turn scripts into workflows and UIs. Fastest workflow engine (5x vs Airflow). Open-source alternative to Airplane and Retool.
infinitic - Infinitic is a scalable workflow engine for distributed services. It shines particularly by making complex orchestration simple. It can be used to reliably orchestrate microservices, manage distributed transactions, operates data pipelines, builds user-facing automation, etc.
states-language-cadence - States Language on Cadence
awesome-workflow-engines - A curated list of awesome open source workflow engines
cronitor-airflow - Cronitor integration for Airflow
gh-action-pypi-publish - The blessed :octocat: GitHub Action, for publishing your :package: distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
stepwise - Clojure AWS Step Functions library
common-workflow-