Top 8 Python weak-supervision Projects

cleanlab

69 8,592 9.4 Python

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Project mention: [Research] Detecting Annotation Errors in Semantic Segmentation Data | /r/MachineLearning | 2023-11-05

We have feely open-sourced our new method for improving segmentation data, published a paper on the research behind it, and released a 5-min code tutorial. You can also read more in the blog if you'd like.

snorkel

5 5,701 5.5 Python

A system for quickly generating training data with weak supervision
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
argilla

15 3,096 9.8 Python

Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.

Project mention: Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF | news.ycombinator.com | 2023-06-05

I'm Dani, CEO and co-founder of Argilla.
Happy to answer any questions you might have and excited to hear your thoughts!
More about Argilla
GitHub: https://github.com/argilla-io/argilla

skweak

8 909 6.2 Python

skweak: A software toolkit for weak supervision applied to NLP tasks
wrench

1 211 5.2 Python

[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
weasel

1 153 3.1 Python

Weakly Supervised End-to-End Learning (NeurIPS 2021) (by autonlab)
zeroshot_topics

3 60 0.0 Python

Topic Inference with Zeroshot models
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
scikit-clean

1 13 2.9 Python

A collection of algorithms for detecting and handling label noise

Project mention: Ask HN: What side projects landed you a job? | news.ycombinator.com | 2023-12-03

Among all these feel-good stories, how about one with a bit different ending?
During my masters, I created a ML library that dealt with noise in dataset. I implemented bunch of papers, but unlike your usual research code, I spent a long time obsessing about it's API, performance, created documentation, CI- the whole shebang [1]. But then, like avg research code, I moved on and promptly forgot about it.
One day about a year ago the cofounder of a very new, small startup working on something similar texted me about the project on linkedin. We chatted for a bit, but as a guy who thinks he's too cool for linkedin, I next logged in and saw his last message about wanting to collaborate about 3/4 months after the fact.
Well they raised $25 million dollars a few months ago :(
[1] https://github.com/Shihab-Shahriar/scikit-clean

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-12-03.