argilla
snorkel
Our great sponsors
| argilla | snorkel | |
|---|---|---|
| 15 | 5 | |
| 3,108 | 5,707 | |
| 5.5% | 0.8% | |
| 9.8 | 5.5 | |
| 3 days ago | 2 months ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
argilla
-
Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF
I'm Dani, CEO and co-founder of Argilla.
Happy to answer any questions you might have and excited to hear your thoughts!
More about Argilla
GitHub: https://github.com/argilla-io/argilla
-
Meet Argilla: An Open-Source Data Curation Platform for Large Language Models (LLMs) and MLOps for Natural Language Processing
Github link: https://github.com/argilla-io/argilla
- Show HN: Argilla and AutoTrain – Train custom NLP models without code
- Rubrix release 0.17.0 with support for the spaCy training format
-
No training data, no problem! Few-shot NER with a practical example
Rubrix, the open-source tool for data-centric NLP: https://github.com/recognai/rubrix
- [D] Expert Advice is needed on designing a feedback Loop for a (Textual Classification + NER) task in Production.
-
[D] How should a former Web Developer, pursue career in Machine Learning?
E.g. https://github.com/recognai/rubrix
-
[P] Small-Text: Active Learning for Text Classification in Python
I have already thought about providing an example of how to integrate small-text with one of the existing labeling tools, such as rubrix rubrix, but that hasn't been started yet.
- Finding and correcting text classification label errors with cleanlab and Rubrix | https://rubrix.readthedocs.io/en/master/tutorials/find_label_errors.html
- Rubrix: Open-source tool for building NLP training sets (now with weak supervision)
snorkel
-
[P] We are building a curated list of open source tooling for data-centric AI workflows, looking for contributions.
The paid product came out of an open source tool: https://github.com/snorkel-team/snorkel
- [Discussion] - "data sourcing will be more important than model building in the era of foundational model fine-tuning"
-
Can't use load_data from utils
Actually, I referenced it in my issue as well. There seems to be different utils.py file in different folders under the snorkel-tutorials repo but the utils file we get after importing snorkel has a different [file](https://github.com/snorkel-team/snorkel/blob/master/snorkel/utils/core.py) ,i.e. the utils file is different in the main snorkel repo
- [D] A hand-picked selection of the best Python ML Libraries of 2021
-
[Discussion] Methods for enhancing high-quality dataset A with low-quality dataset
Snorkel (https://github.com/snorkel-team/snorkel) might provide you exactly what you are looking for. From the docs:
What are some alternatives?
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
skweak - skweak: A software toolkit for weak supervision applied to NLP tasks
doccano - Open source annotation tool for machine learning practitioners.
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python
cleanlab - The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
weasel - Weakly Supervised End-to-End Learning (NeurIPS 2021)
data-centric-ai - Resources for Data Centric AI
caer - High-performance Vision library in Python. Scale your research, not boilerplate.
trankit - Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
dalle-flow - 🌊 A Human-in-the-Loop workflow for creating HD images from text
snorkel-tutorials - A collection of tutorials for Snorkel