Top 11 data-centric-ai Open-Source Projects

cleanlab

69 8,673 9.4 Python

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Project mention: [Research] Detecting Annotation Errors in Semantic Segmentation Data | /r/MachineLearning | 2023-11-05

We have feely open-sourced our new method for improving segmentation data, published a paper on the research behind it, and released a 5-min code tutorial. You can also read more in the blog if you'd like.

refinery

20 1,365 4.5 Python

The data scientist's open-source choice to scale, assess and maintain natural language data. Treat training data like a software artifact.
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
data-centric-ai

1 1,070 0.0 TeX

Resources for Data Centric AI
spotlight

24 1,014 9.8 TypeScript

Interactively explore unstructured datasets from your dataframe. (by Renumics)

Project mention: Renumics/spotlight: Interactively explore unstructured datasets from dataframes | news.ycombinator.com | 2024-03-10

data-centric-AI

4 986 4.5

A curated, but incomplete, list of data-centric AI resources. (by daochenzha)
cleanvision

4 923 7.3 Python

Automatically find issues in image datasets and practice data-centric computer vision.
awesome-open-data-centric-ai

1 680 5.8

Curated list of open source tooling for data-centric AI on unstructured data.
SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
dcai-lab

10 401 5.4 Jupyter Notebook

Lab assignments for Introduction to Data-Centric AI, MIT IAP 2024 👩🏽‍💻

Project mention: Resources to learn practical/industry-focused ML (preferably using TensorFlow)? | /r/learnmachinelearning | 2023-07-11

Data-Centric AI honestly if you've been working on ML pipelines this might be familiar to you

wrench

1 211 5.2 Python

[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
dcai-course

3 87 7.6 CSS

Introduction to Data-Centric AI, MIT IAP 2023 🤖
clustering-plugin

1 5 6.4 Python

Compute clustering on your data in a visual, intuitive way with FiftyOne and Sklearn!

Project mention: How to Cluster Images | dev.to | 2024-04-09

fiftyone plugins download https://github.com/jacobmarks/clustering-plugin

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

data-centric-ai related posts

Renumics/spotlight: Interactively explore unstructured datasets from dataframes

1 project | news.ycombinator.com | 10 Mar 2024
Open source data analysis software for vehicle data/telemetry - feedback and contributions welcome

1 project | /r/Python | 16 Nov 2023
OSS project: Interactively explore 🤗 datasets with one line of code

1 project | /r/Python | 27 Oct 2023
Show HN: Interactively explore your Hugging Face dataset with one line of code

1 project | news.ycombinator.com | 25 Oct 2023
Hacktoberfest Machine Learning Projects for JS/TS Developers 🎃

5 projects | dev.to | 20 Oct 2023
[P] Quick fine-tuning image classification models from Bing image search

1 project | /r/MachineLearning | 22 Sep 2023
Unstructured Data? No Problem. Spotlight Makes Exploration a Breeze!

1 project | /r/u_44sps | 15 Sep 2023
A note from our sponsor - SaaSHub
www.saashub.com | 6 May 2024

SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source data-centric-ai projects? This list will help you:

	Project	Stars
1	cleanlab	8,673
2	refinery	1,365
3	data-centric-ai	1,070
4	spotlight	1,014
5	data-centric-AI	986
6	cleanvision	923
7	awesome-open-data-centric-ai	680
8	dcai-lab	401
9	wrench	211
10	dcai-course	87
11	clustering-plugin	5