awesome-mlops
bodywork
awesome-mlops | bodywork | |
---|---|---|
24 | 8 | |
11,738 | 430 | |
- | - | |
5.2 | 0.0 | |
9 days ago | 9 months ago | |
Python | ||
- | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-mlops
- MLOps
-
ML Engineer Roadmap
I'm in the same boat. Data scientist shifting towards ML engineering-MLOps. The guide seems quite complete. I am also doing the ML DevOps engineer, which has end-to-end projects and has been helpful so far. I also feel that most ML engineers will be Mlops too, as most companies will not distinguish between the two, so I try to focus on this part. Here is a quite comprehensive list of resources: https://github.com/visenger/awesome-mlops
-
Mlops roadmap
Good Reference: https://github.com/visenger/awesome-mlops (The Link above has so many Guides, It's insane) https://madewithml.com/
- What do data scientists use Docker for?
-
Do you wonder why MLOps is not at the same level as DevOps?
I recently did a deep-dive into MLOps for a client, and I've found that https://ml-ops.org/ offers a great overview. Some topics are a bit too "zoomed out", but they still touch on most important aspects of building an end-to-end product. I found it a great starting point when doing research, and picking and choosing some key points from each section + some google helped a lot. Give it a look, you'll probably find some useful things in there.
- Can you guys explain to me what MLOps is?
-
MLOps on GitHub Actions with Cirun
MLOps
- DevOps - where to begin?
-
JBCNConf 2022: A great farewell
She made mentions to ML-Ops and MLFlow including Vertex AI the GCP implementation. I will post the video as soon as it is available. In the meantime, you can enjoy any other talk from Nerea Luis
-
Can Mechanical Engineers become MLOps?
From your post, you seem to be trained for data science for physics modeling, so I'd recommend to get started with https://ml-ops.org/ and for the data engineering part, I found this https://github.com/andkret/Cookbook open source cookbook to be invaluable.
bodywork
- Deployment automation for ML projects of all shapes and sizes
-
A tutorial on how to handle prediction uncertainty in production systems, by using Bayesian inference and probabilistic programs
how to deploy it to Kuberentes using Bodywork.
-
[P] [D] How are you approaching prediction uncertainty in ML systems?
I usually turn to generative models - e.g. probabilistic programs and Bayesian inference. I’ve written-up my thoughts on how to engineer these into a ‘production system’ deployed to Kubernetes, using PyMC and Bodywork (an open-source ML deployment tool that I contribute to).
- Bodywork: MLOps tool for deploying ML projects to Kubernetes
-
Tool for mapping executable Python modules to Kubernetes deployments
I’m one of the core contributors to Bodywork, an open-source tool for deploying machine learning projects developed in Python, to Kubernetes.
-
[P] [D] The benefits of training the simplest model you can think of and deploying it to production, as soon as you can.
I’ve had many successes with this approach. With this in mind, I’ve put together an example of how to make this Agile approach to developing machine learning systems a reality, by demonstrating that it takes under 15 minutes to deploy a Scikit-Learn model, using FastAPI with Bodywork (an open-source MLOps tool that I have built).
- bodywork - MLOps for Python and K8S
- bodywork-ml/bodywork-core - MLOps automation for Python and Kubernetes
What are some alternatives?
metaflow - :rocket: Build and manage real-life ML, AI, and data science projects with ease!
NuPIC - Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.
kserve - Standardized Serverless ML Inference Platform on Kubernetes
gensim - Topic Modelling for Humans
Made-With-ML - Learn how to design, develop, deploy and iterate on production-grade ML applications.
PaddlePaddle - PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
Awesome-Federated-Learning - FedML - The Research and Production Integrated Federated Learning Library: https://fedml.ai
Crab - Crab is a flexible, fast recommender engine for Python that integrates classic information filtering recommendation algorithms in the world of scientific Python packages (numpy, scipy, matplotlib).
applied-ml - 📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
TFLearn - Deep learning library featuring a higher-level API for TensorFlow.
awesome-mlops - :sunglasses: A curated list of awesome MLOps tools
PyBrain