dataqa
argilla
Our great sponsors
dataqa | argilla | |
---|---|---|
7 | 15 | |
245 | 3,096 | |
- | 5.1% | |
6.2 | 9.8 | |
almost 2 years ago | 5 days ago | |
JavaScript | Python | |
GNU General Public License v3.0 only | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dataqa
-
[D] Looking for open source projects to contribute
Hey, I am the creator and (only contributor today) of open-source https://github.com/dataqa/dataqa, a Python library to explore and annotate documents. It uses weak supervision, is based on spacy, and has a lot of opportunities to add more deep learning and ML functionality. I can guide you through it :-). This would be a great opportunity to be first and lead contributor of an open-source library (outside the creator).
-
[P]: Extract and label data from Wikipedia with DataQA
I recently added a new feature to DataQA (https://github.com/dataqa/dataqa) to be able to extract entities from Wikipedia. All you need to do is upload a file with Wikipedia urls:
-
Show HN: DataQA – now possible to link entities to large ontologies
The open-source project is here: https://github.com/dataqa/dataqa. I have just released a feature which I have been working on for a while to solve a problem which I've seen a lot in industry: how to map entities found in text to large knowledge base ontologies.
-
[P] Using rules to speed up labelling by 2x
The tool I developed and used for this problem: https://github.com/dataqa/dataqa
-
The First Rule of Machine Learning: Start Without Machine Learning
I have seen first hand at small and large companies how problems have been tackled with ML without trying a simple rule or heuristic first. And then, further down the line, the system has been compared to a few business rules put together, to find that the difference in performance did not explain the deployment of an ML system in the first place.
It's true that if your rules grow in complexity, this might make it harder to maintain, but the good thing about rules is that they tend to be fully explainable, and they can be encoded by domain experts. So the maintenance of such a system does not need to be done exclusively by an ML engineer anymore.
Here is where I insert my plug: I have developed a tool to create rules to solve NLP problems: https://github.com/dataqa/dataqa
- Show HN: Rules-based labelling tool for NLP
-
DataQA: the new Python app to do rules-based text annotation
After working in ML for more than a decade, I became frustrated over time with the lack of tools to create baselines using simple rules and heuristics. It is well known that most business problems out there can achieve decent baselines using only heuristics. This is why I have developed DataQA (https://github.com/dataqa/dataqa), which uses NLP rules to do common NLP annotation tasks, such as multiclass classification or named entity recognition.
argilla
-
Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF
I'm Dani, CEO and co-founder of Argilla.
Happy to answer any questions you might have and excited to hear your thoughts!
More about Argilla
GitHub: https://github.com/argilla-io/argilla
-
Meet Argilla: An Open-Source Data Curation Platform for Large Language Models (LLMs) and MLOps for Natural Language Processing
Github link: https://github.com/argilla-io/argilla
- Show HN: Argilla and AutoTrain – Train custom NLP models without code
- Rubrix release 0.17.0 with support for the spaCy training format
-
No training data, no problem! Few-shot NER with a practical example
Rubrix, the open-source tool for data-centric NLP: https://github.com/recognai/rubrix
- [D] Expert Advice is needed on designing a feedback Loop for a (Textual Classification + NER) task in Production.
-
[D] How should a former Web Developer, pursue career in Machine Learning?
E.g. https://github.com/recognai/rubrix
-
[P] Small-Text: Active Learning for Text Classification in Python
I have already thought about providing an example of how to integrate small-text with one of the existing labeling tools, such as rubrix rubrix, but that hasn't been started yet.
- Finding and correcting text classification label errors with cleanlab and Rubrix | https://rubrix.readthedocs.io/en/master/tutorials/find_label_errors.html
- Rubrix: Open-source tool for building NLP training sets (now with weak supervision)
What are some alternatives?
diffgram - The AI Datastore for Schemas, BLOBs, and Predictions. Use with your apps or integrate built-in Human Supervision, Data Workflow, and UI Catalog to get the most value out of your AI Data.
snorkel - A system for quickly generating training data with weak supervision
general
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
docarray - Represent, send, store and search multimodal data
doccano - Open source annotation tool for machine learning practitioners.
poutyne - A simplified framework and utilities for PyTorch
cleanlab - The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
habitat-sim - A flexible, high-performance 3D simulator for Embodied AI research.
data-centric-ai - Resources for Data Centric AI
vosk-api - Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
trankit - Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing