snorkel
dcai-lab
Our great sponsors
snorkel | dcai-lab | |
---|---|---|
5 | 10 | |
5,685 | 388 | |
0.8% | 2.6% | |
5.5 | 5.4 | |
about 1 month ago | 3 months ago | |
Python | Jupyter Notebook | |
Apache License 2.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
snorkel
-
[P] We are building a curated list of open source tooling for data-centric AI workflows, looking for contributions.
The paid product came out of an open source tool: https://github.com/snorkel-team/snorkel
- [Discussion] - "data sourcing will be more important than model building in the era of foundational model fine-tuning"
-
Can't use load_data from utils
Actually, I referenced it in my issue as well. There seems to be different utils.py file in different folders under the snorkel-tutorials repo but the utils file we get after importing snorkel has a different [file](https://github.com/snorkel-team/snorkel/blob/master/snorkel/utils/core.py) ,i.e. the utils file is different in the main snorkel repo
- [D] A hand-picked selection of the best Python ML Libraries of 2021
dcai-lab
-
Andrew NG, github courses
Another great resource inspired by the Andrew Ng data-centric AI movement is the Introduction to Data-Centric AI course taught this past semester at MIT by PhDs.
-
[P] We are building a curated list of open source tooling for data-centric AI workflows, looking for contributions.
Thanks for the kind words! Make sure to check out the current open MIT course if you are just starting out: https://dcai.csail.mit.edu/
-
The Missing Semester of Your CS Education
Introduction to Data-Centric AI https://dcai.csail.mit.edu
- Introduction to Data-Centric AI
-
MIT Introduction to Data-Centric AI
Course homepage | Lecture videos on YouTube | Lab Assignments
What are some alternatives?
skweak - skweak: A software toolkit for weak supervision applied to NLP tasks
argilla - Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python
weasel - Weakly Supervised End-to-End Learning (NeurIPS 2021)
caer - High-performance Vision library in Python. Scale your research, not boilerplate.
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
snorkel-tutorials - A collection of tutorials for Snorkel
dgl - Python package built to ease deep learning on graph, on top of existing DL frameworks.
awesome-production-machine-learning - A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
cleanlab - The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
llm-course - Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.