aqueduct
flyte
| aqueduct | flyte | |
|---|---|---|
| 2 | 31 | |
| 521 | 4,820 | |
| 0.0% | 3.1% | |
| 8.7 | 9.8 | |
| 11 months ago | 5 days ago | |
| Go | Go | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aqueduct
-
Aqueduct: Take Data Science to Production
Hi everyone!
We've been working on making data teams more productive with Aqueduct for over a year, and we're really excited to share what we've been building.
There's a large (and growing!) number of programmers in the world who understand data and can solve business problems but don't want to spend their time wrangling low-level cloud infrastructure to get their work into the cloud. The existing MLOps tools that claim to solve this problem have been built by & for software teams, and they're incredibly complicated.
With Aqueduct, we've built a tool that's designed for data teams and abstracts away the underlying infrastructure. Aqueduct has a simple Python API that allows you to define a workflow as a composition of Python functions. Those workflows can be easily connected to data sources and can be run anywhere from your laptop to a Kubernetes cluster in the cloud. Once a workflow's running, Aqueduct has lightweight hooks to compute metrics and run tests over your pipelines to ensure they're producing high-quality results.
To learn more about what we're building, check out our GitHub repo or join our community Slack:
https://github.com/aqueducthq/aqueduct
flyte
-
First 15 Open Source Advent projects
9. Flyte by Union AI | Github | tutorial
-
Flyte 1.10: Self-hosted solution to build production-grade data and ML pipelines; now ships with monorepo, new agents and sensors, eager workflows and more 🚀 (4.1k stars on GitHub)
GitHub: https://github.com/flyteorg/flyte
-
Flyte: Open-source orchestrator for building production-grade ML pipelines
This is actually but a link to Flyte, this is a link to the documentation for the Flyte integration in LangChain, a separate product.
Flyte's homepage is https://flyte.org/
- Flyte: Advanced workflow orchestration alternative to Apache Airflow
-
Orchestration: Thoughts on Dagster, Airflow and Prefect?
Anyone tried Flyte?
-
Flyte 1.6.0: Self-hosted solution to build production-grade data and ML pipelines; now ships with PyTorch elastic training, image specification without dockerfile, enhanced task execution insights and more 🚀 (3.4k stars on GitHub)
Website: https://flyte.org/
-
Flyte(v1.5.0) - Self-hosted solution to build production-grade data and ML pipelines; now ships with streaming support, pod templates, partial tasks and more 🚀 (3.2k stars on GitHub)
Flyte is an open source orchestration tool for managing the workflow of machine learning and AI projects. It runs on top of Kubernetes.
- Flyte: Open-Source Kubernetes-Native ML Orchestrator Implemented in Go
-
What is MLOps and how to get started? | MLOps series | Deploying ML in production
I have a question though, what is your opinion on https://flyte.org. My pipeline uses this and it’ll be interesting to get your perspectives on it’s capabilities.
-
Github alternative for ML?
Have you looked at flyte.org. It aims to bring "versioning", "compute" and "reproducibility" together in one package.
What are some alternatives?
llama2.go - LLaMA-2 in native Go
metaflow - :rocket: Build and manage real-life ML, AI, and data science projects with ease!
CortexTheseus - Cortex - AI on Blockchain, Official Golang implementation
argo - Workflow Engine for Kubernetes
sematic - An open-source ML pipeline development platform
temporal - Temporal service
fullnamematchscore-go - Generates a match score of two person names from 0-100, where 100 is the highest, on how closely two individual full names match. The scoring is based on a series of tests, algorithms, AI, and an ever-growing body of Machine Learning-based generated knowledge
kubeflow - Machine Learning Toolkit for Kubernetes
aim - Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
Celery-Kubernetes-Operator - An operator to manage celery clusters on Kubernetes (Work in Progress)
deeplake - Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
Kedro - Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.