flyte
awesome-workflow-engines
flyte | awesome-workflow-engines | |
---|---|---|
31 | 11 | |
4,820 | 5,612 | |
3.1% | - | |
9.8 | 5.8 | |
1 day ago | 2 days ago | |
Go | Java | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flyte
-
First 15 Open Source Advent projects
9. Flyte by Union AI | Github | tutorial
-
Flyte 1.10: Self-hosted solution to build production-grade data and ML pipelines; now ships with monorepo, new agents and sensors, eager workflows and more đ (4.1k stars on GitHub)
GitHub: https://github.com/flyteorg/flyte
-
Flyte: Open-source orchestrator for building production-grade ML pipelines
This is actually but a link to Flyte, this is a link to the documentation for the Flyte integration in LangChain, a separate product.
Flyte's homepage is https://flyte.org/
- Flyte: Advanced workflow orchestration alternative to Apache Airflow
-
Orchestration: Thoughts on Dagster, Airflow and Prefect?
Anyone tried Flyte?
-
Flyte 1.6.0: Self-hosted solution to build production-grade data and ML pipelines; now ships with PyTorch elastic training, image specification without dockerfile, enhanced task execution insights and more đ (3.4k stars on GitHub)
Website: https://flyte.org/
-
Flyte(v1.5.0) - Self-hosted solution to build production-grade data and ML pipelines; now ships with streaming support, pod templates, partial tasks and more đ (3.2k stars on GitHub)
Flyte is an open source orchestration tool for managing the workflow of machine learning and AI projects. It runs on top of Kubernetes.
- Flyte: Open-Source Kubernetes-Native ML Orchestrator Implemented in Go
-
What is MLOps and how to get started? | MLOps series | Deploying ML in production
I have a question though, what is your opinion on https://flyte.org. My pipeline uses this and itâll be interesting to get your perspectives on itâs capabilities.
-
Github alternative for ML?
Have you looked at flyte.org. It aims to bring "versioning", "compute" and "reproducibility" together in one package.
awesome-workflow-engines
-
Looking for an orchestration engine for HTTP requests similar to âPostman flowsâ I can selfhost.
I've come across this list, but I'm uncertain about which option would suit my requirements without going through a trial-and-error process. Do you have any recommendations for a tool similar to "Postman flows" that enables the creation of chained HTTP requests and allows for response analysis?
-
Building a distributed workflow engine from scratch
True, there are many options out there. And we looked at a good number before we made the decision to build one ourselves. But at least at the time (circa 2014), many of the existing options were either not designed for a distributed environment, were designed more particularly for data-processing use cases, were seemingly abandoned, or simply felt over-engineered to our taste.
- Building some âmarketing automationâ esque features into a CRM. Am I looking for a rules engine?
-
Dabbling with Dagster vs. Airflow
I'd say give Temporal (https://temporal.io) a look, but there are a lot of options (https://github.com/meirwah/awesome-workflow-engines).
- Are there any good resources for building data pipelines?
- Any bpmn engine out there?
-
CSV File automation
I believe the type of software you're looking for is a workflow engine. I've found this list of them, perhaps there's some in the list that could work for your needs: https://github.com/meirwah/awesome-workflow-engines
- Looking for genuine feedback on if my idea is good or not!
-
Looking for a tutorial to develop a workflow service
https://github.com/meirwah/awesome-workflow-engines links to a bunch of open source workflow engines. If you donât find a tutorial, maybe try one of those and see if the code is small enough to read easily.
-
State machines are wonderful tools
[2] https://github.com/meirwah/awesome-workflow-engines
What are some alternatives?
metaflow - :rocket: Build and manage real-life ML, AI, and data science projects with ease!
xstate - Actor-based state management & orchestration for complex app logic.
argo - Workflow Engine for Kubernetes
RE2 - RE2 is a fast, safe, thread-friendly alternative to backtracking regular expression engines like those used in PCRE, Perl, and Python. It is a C++ library.
temporal - Temporal service
common-workflow-language - Repository for the CWL standards. Use https://cwl.discourse.group/ for support đ
kubeflow - Machine Learning Toolkit for Kubernetes
processus - A simple lightweight nodejs workflow engine designed to help orchestrate multiple tasks.
Celery-Kubernetes-Operator - An operator to manage celery clusters on Kubernetes (Work in Progress)
tork-web - Web UI for Tork Workflow Engine
Kedro - Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
proposals - Temporal proposals