dagster-example-pipeline
mlrun
dagster-example-pipeline | mlrun | |
---|---|---|
1 | 3 | |
64 | 1,301 | |
- | 4.7% | |
0.0 | 9.9 | |
about 2 years ago | 4 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dagster-example-pipeline
-
Developing in Dagster
The associated code repo can be found here
mlrun
- Discussion on Need of Feature Stores
-
I reviewed 50+ open-source MLOps tools. Here’s the result
You should also add MLRun: https://github.com/mlrun/mlrun
- Has anyone here been able to deploy Mlrun successfully on Kubernetes cluster?
What are some alternatives?
Apache Superset - Apache Superset is a Data Visualization and Data Exploration Platform [Moved to: https://github.com/apache/superset]
feast - Feature Store for Machine Learning
AWS Data Wrangler - pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
flyte - Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
Prefect - The easiest way to build, run, and monitor data pipelines at scale.
SmartSim - SmartSim Infrastructure Library.
canarypy - CanaryPy - A light and powerful canary release for Data Pipelines
phidata - Add memory, knowledge and tools to LLMs
portable-data-stack-dagster - A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB, PostgreSQL and Superset
mosec - A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
aws-data-wrangler - pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL). [Moved to: https://github.com/aws/aws-sdk-pandas]
ploomber - The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️