common-workflow-language
toil
common-workflow-language | toil | |
---|---|---|
6 | 2 | |
1,441 | 870 | |
0.4% | 0.3% | |
1.1 | 9.2 | |
5 months ago | 1 day ago | |
Common Workflow Language | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
common-workflow-language
-
Nextflow: Data-Driven Computational Pipelines
https://www.commonwl.org/
https://github.com/common-workflow-language/common-workflow-...
- Common Workflow Language (CWL)
- Are there any good resources for building data pipelines?
- Common Workflow Language
-
Kestra - Open-Source Airflow Alternative
And we can add it to the ever-growing list of existing workflow frameworks; https://github.com/common-workflow-language/common-workflow-language/wiki/Existing-Workflow-systems
toil
-
Show HN: Hatchet – Open-source distributed task queue
a little late now, but I wonder if https://github.com/DataBiosphere/toil might meet your requirements
- Lessons Learned from Running Apache Airflow at Scale
What are some alternatives?
kestra - Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
luigi - Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
nextflow - A DSL for data-driven computational pipelines
direktiv - Serverless Container Orchestration
infinitic - Infinitic is a scalable workflow engine for distributed services. It shines particularly by making complex orchestration simple. It can be used to reliably orchestrate microservices, manage distributed transactions, operates data pipelines, builds user-facing automation, etc.
windmill - Open-source developer platform to turn scripts into workflows and UIs. Fastest workflow engine (5x vs Airflow). Open-source alternative to Airplane and Retool.
awesome-workflow-engines - A curated list of awesome open source workflow engines
states-language-cadence - States Language on Cadence
gh-action-pypi-publish - The blessed :octocat: GitHub Action, for publishing your :package: distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
cronitor-airflow - Cronitor integration for Airflow
common-workflow-
stepwise - Clojure AWS Step Functions library