snorkel
awesome-production-machine-learning
Our great sponsors
snorkel | awesome-production-machine-learning | |
---|---|---|
5 | 9 | |
5,707 | 15,947 | |
0.8% | 2.1% | |
5.5 | 7.4 | |
about 2 months ago | 3 days ago | |
Python | ||
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
snorkel
-
[P] We are building a curated list of open source tooling for data-centric AI workflows, looking for contributions.
The paid product came out of an open source tool: https://github.com/snorkel-team/snorkel
- [Discussion] - "data sourcing will be more important than model building in the era of foundational model fine-tuning"
-
Can't use load_data from utils
Actually, I referenced it in my issue as well. There seems to be different utils.py file in different folders under the snorkel-tutorials repo but the utils file we get after importing snorkel has a different [file](https://github.com/snorkel-team/snorkel/blob/master/snorkel/utils/core.py) ,i.e. the utils file is different in the main snorkel repo
- [D] A hand-picked selection of the best Python ML Libraries of 2021
-
[Discussion] Methods for enhancing high-quality dataset A with low-quality dataset
Snorkel (https://github.com/snorkel-team/snorkel) might provide you exactly what you are looking for. From the docs:
awesome-production-machine-learning
-
Exploring Open-Source Alternatives to Landing AI for Robust MLOps
One trove of treasures is the awesome-production-machine-learning repository on GitHub. This curated list provides a multitude of frameworks, libraries, and software designed to facilitate various stages of the ML lifecycle.
-
[P] We are building a curated list of open source tooling for data-centric AI workflows, looking for contributions.
There is a cool, gigantic list for MLOps that I can recommend: https://github.com/EthicalML/awesome-production-machine-learning
-
How much of a full DS project pipeline can I do for free?
There are a lot of frameworks and specific tools out there that try to make production ML projects viable; from specific like Airflow (orchestrating jobs) and MLflow (experiment tracking) to more complex ones like Kubeflow. You can have a grasp here.
-
Sqldiff: SQLite Database Difference Utility
https://github.com/EthicalML/awesome-production-machine-lear...
- [D] What are the best resources to crack M L system design interviews?
-
I'm looking for a tool that let's you visualize the models architecture like this. Any idea what it is called?
https://github.com/EthicalML/awesome-production-machine-learning I think you will find most of the tools to visualize the model on this link.
- Awesome production machine learning - curated list of awesome open source libraries that will help you deploy, monitor, version, scale, and secure your production machine learning [free] [website] [@all]
-
Crucial differences in MLOps for deep learning
2/ https://github.com/EthicalML/awesome-production-machine-learning
What are some alternatives?
skweak - skweak: A software toolkit for weak supervision applied to NLP tasks
shap - A game theoretic approach to explain the output of any machine learning model.
argilla - Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
awesome-jax - JAX - A curated list of resources https://github.com/google/jax
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python
netron - Visualizer for neural network, deep learning and machine learning models
weasel - Weakly Supervised End-to-End Learning (NeurIPS 2021)
awesome-mlops - :sunglasses: A curated list of awesome MLOps tools
caer - High-performance Vision library in Python. Scale your research, not boilerplate.
awesome-ml-for-cybersecurity - :octocat: Machine Learning for Cyber Security
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
datascience - Curated list of Python resources for data science.