ploomber-engine
unionml
| ploomber-engine | unionml | |
|---|---|---|
| 2 | 6 | |
| 59 | 330 | |
| - | 1.2% | |
| 7.0 | 4.0 | |
| 2 months ago | 6 months ago | |
| Python | Python | |
| BSD 3-clause "New" or "Revised" License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ploomber-engine
-
Who needs MLflow when you have SQLite?
If you need help, you can open an issue on GitHub (https://github.com/ploomber/ploomber-engine) or join our Slack! (https://ploomber.io/community/)
-
Running Jupyter notebooks in parallel
As a third option we will use Papermill again, but now with the ploomber-engine, which adds debugging and profiling features to Papermill:
unionml
-
Who needs MLflow when you have SQLite?
Checkout Flyte.org and it’s sibling project https://www.union.ai/unionml
- UnionML: the easiest way to build and deploy machine learning microservices
- GitHub - unionai-oss/unionml: UnionML: the easiest way to build and deploy machine learning microservices
-
Show HN: UnionML – a Python framework for building ML microservices
Hi HN!
Niels here. I'm the creator of *UnionML*, a Python MLOps framework that removes the boilerplate and friction associated with building and deploying machine learning systems to production.
I've been training and deploying models for almost a decade now, and one pain-point I've consistently had is managing the complexity of building and maintaining an ML stack that works for the entire model development lifecycle - from prototyping to production.
UnionML is built on top of Flyte (https://www.flyte.org) and exposes a functional interface for defining the building blocks of your ML application via decorators -- think Flask or FastAPI method endpoints -- and UnionML takes care of bundling them into microservices for different use cases such as:
- model training
- batch prediction
- online prediction
- (more coming soon!)
This project aims to unify the rich ecosystem of data, ML, and MLOps tools that have emerged over the last decade or so (e.g. MLFlow, Sagemaker, Spark, etc.) to provide a nice UX for model developers, in both individual and team settings.
It's very early days for this project, so if you're interested in getting involved or learning more, you can go to the:
- Docs: https://unionml.readthedocs.io/en/latest/
- Repo: https://github.com/unionai-oss/unionml
- Slack: https://flyte-org.slack.com/archives/C03JL38L65V
What are some alternatives?
ganimede
rubicon-ml - Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!
african_microbiome_portal_data - Raw and corrected data with correction python notebook
Kedro - Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
papermill - 📚 Parameterize, execute, and analyze notebooks
neptune-client - 📘 The MLOps stack component for experiment tracking
ploomber - The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️