Top 17 data-labeling Open-Source Projects

• label-studio

  50 16,546 9.8 JavaScript

  Label Studio is a multi-type data labeling and annotation tool with standardized output format

  

Project mention: Annotation is dead | dev.to | 2024-04-26

If instead you have a cohort on hand — -i.e., you do not want to send your data to a third party for any reason, or perhaps you have energetic undergrads — -then you could alternatively consider local, open-source annotation such as CVAT and Label Studio. Finally, nowadays, you might instead work with Large Multimodal Models to have them annotate your data; more on this awkward angle later.

• doccano

  13 8,996 7.4 Python

  Open source annotation tool for machine learning practitioners.

  

Project mention: You Can't Have a Free Software AI Stack | news.ycombinator.com | 2023-07-13

Huh?

I wrote my own system for classifying a stream of texts in Python, I might Open Source it one of these days but I have to get it to the point where it is modular enough that I can customize it to do the particular things I want without subjecting people to my whims... I use it every day and I'm not afraid to demo it because it is rock solid.

My understanding is that my system would not be hard to adapt to work on images for certain kinds of tasks.

Pytorch is open source, Huggingface is open source. CUDA isn't. This is

https://labelstud.io/

and for annotating text spans there are so many open source tools

https://github.com/doccano/doccano

I worked for a company a few years back that built annotation tools for projects we sold to customers but never quite got to a polished general purpose annotator. Today there are an overwhelming number of companies in this space and products I never heard of, many of which are cloud based or paid. Looks like a gold rush to me.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• cleanlab

  69 8,673 9.4 Python

  The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

  

Project mention: [Research] Detecting Annotation Errors in Semantic Segmentation Data | /r/MachineLearning | 2023-11-05

We have feely open-sourced our new method for improving segmentation data, published a paper on the research behind it, and released a 5-min code tutorial. You can also read more in the blog if you'd like.

• awesome-data-labeling

  7 3,480 0.0

  A curated list of awesome data labeling tools

  

• refinery

  20 1,365 4.5 Python

  The data scientist's open-source choice to scale, assess and maintain natural language data. Treat training data like a software artifact.

  

• compose

  1 472 3.6 Python

  A machine learning tool for automated prediction engineering. It allows you to easily structure prediction problems and generate labels for supervised learning. (by alteryx)

  

• bbox-visualizer

  2 374 4.8 Python

  Make drawing and labeling bounding boxes easy as cake

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• hover

  1 314 1.6 Python

  :speedboat: Label data at scale. Fun and precision included. (by phurwicz)

• markup

  3 231 6.9 TypeScript

  A web-based document annotation tool, powered by GPT-4 :rocket: (by samueldobbie)

Project mention: Show HN: An annotation tool for ML and NLP | news.ycombinator.com | 2023-05-15

Hey HN! I'm super excited to share Markup with you, which is a totally free & open-source annotation tool that helps you transform unstructured text (e.g. news articles) into structured data that you can use for building, training, or fine-tuning ML models!

Check it out: https://github.com/samueldobbie/markup

• awesome-annotation-tools

  1 180 10.0

  A curated list of awesome data annotation tools

  

• mutate

  1 149 0.0 Python

  A library to synthesize text datasets using Large Language Models (LLM)

• superpipe

  1 98 8.9 Python

  Superpipe - optimized LLM pipelines for structured data

  

Project mention: Show HN: Superpipe – optimized LLM pipelines for structured outputs | news.ycombinator.com | 2024-03-26

• edsl

  1 53 9.9 Python

  Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs. (by expectedparrot)

  

Project mention: Python package for administering surveys to LLMs | news.ycombinator.com | 2024-04-18

• modzy-labelstudio-sample

  1 17 10.0 Python

  Create training data labels from a production model with Modzy, Dropbox, and Label Studio

  

• bunny-party

  1 10 4.7 Python

  A demonstration of how DVC and MLFlow can be used in the task of data relabeling

Project mention: Show HN: Demo of using DVC and MLFlow for ML experiments | news.ycombinator.com | 2024-01-29

• detecting-beer

  1 10 2.4 Jupyter Notebook

  Определение количества позиций товара на витрине по фотографиям. (label-studio, yolov5, torch, rabbitmq, pika, docker-compose)

• datalabel

  1 2 10.0 HTML

  datalabel is a UI-based data editing tool that makes it easy to create labeled text data in a dataframe. With datalabel, you can quickly and effortlessly edit your data without having to write any code. Its intuitive interface makes it ideal for both experienced data professionals and those new to data editing.

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

data-labeling related posts

• You Can't Have a Free Software AI Stack

  2 projects | news.ycombinator.com | 13 Jul 2023

• How we used AI to automate stock sentiment classification

  1 project | dev.to | 21 Feb 2023

• German's NLP startup Kern AI has raised €2.7M in seed funding to accelerate its recent growth

  1 project | /r/u_technicalbeep | 16 Feb 2023

• Why and how we started Kern AI (our seed funding announcement)

  1 project | dev.to | 16 Feb 2023

• GPT and BERT: A Comparison of Transformer Architectures

  2 projects | dev.to | 9 Feb 2023

• Open-source tool to label, assess and maintain natural language data. Treat training data like a software artifact!

  1 project | /r/LanguageTechnology | 25 Jan 2023

• Drastically decrease the size of your Docker application

  2 projects | dev.to | 3 Jan 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 4 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com