Top 11 Python synthetic-dataset-generation Projects

synthetic-dataset-generation

• Add a project

1. distilabel

   1 2 2,552 9.5 Python

   Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

   

   Project mention: Distilabel is a framework for synthetic data and AI feedback | news.ycombinator.com | 2025-01-28

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. AutoPrompt

   2 1 2,419 7.7 Python

   A framework for prompt tuning using Intent-based Prompt Calibration

   

4. DataDreamer

   3 5 983 7.1 Python

   DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

   

   Project mention: FLaNK AI - 01 April 2024 | dev.to | 2024-04-01

5. curator

   4 2 961 9.9 Python

   Synthetic data curation for post-training and structured data extraction (by bespokelabsai)

   

   Project mention: Gemini 50% cheaper with Batch API in Curator | dev.to | 2025-03-14

   Read more about other API batch processing offered by Curator for OpenAI, Anthropic and more here.

6. bonito

   5 1 749 5.6 Python

   A lightweight library for generating synthetic instruction tuning datasets for your data without GPT. (by BatsResearch)

   

7. pygraft

   6 1 681 6.0 Python

   Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips

   

8. DoppelGANger

   7 14 303 3.8 Python

   [IMC 2020 (Best Paper Finalist)] Using GANs for Sharing Networked Time Series Data: Challenges, Initial Promise, and Open Questions

   

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. VQASynth

    8 1 306 8.5 Python

    Compose multimodal datasets 🎹

    

11. DeFMO

    9 1 171 1.8 Python

    [CVPR 2021] DeFMO: Deblurring and Shape Recovery of Fast Moving Objects

12. dataformer

    10 1 145 8.8 Python

    Solving data for LLMs - Create quality synthetic datasets!

    

    Project mention: AIM Weekly for 07 Oct 2024 | dev.to | 2024-10-07

    🫶 Building Resilient AI Infrastructure: Deep Dive Zilliz Cloud's New Production-Ready Features 🙅 Contributing to Open Source 🛠️ Upcoming Data Engineering Best Practices for AI 📝 Building Scalable Image Retrieval 💫 NASA and IBM Weather Model 🙌 Improve Rag with Knowledge Graphs 🦾 Leader 📎 Evaluating RAG 🚙 Solid Data Curation 🤖 Sparse and Dense Embeddings 🍔 Cohere LLM University 📢 DataFormer for Synthetic Data 📢 PDF2Audio 📊 Screenpipe 📱 Vector DB Bencmarks 🛼 Extreme Quantization 📢 AI Powered Question & Answering 🐈‍⬛ Building LLMS Stanford Class 🌐 New Python Web UI 📊 Visualize RAG 🌐 Free Map Hosting 📊 Pipefunc 🖥️ The Pipe to extract 👽 New Audio Model 🧐 Easy Milvus Schema Generation 👽 Multimodal Models 72B 🌐 Fivetran + Milvus 🗣️ JSON Viewer 👽 ONNX Runtime GenAI 🚙 LLM Explorer 🦾 Interesting Computer Vision Techniques 📊 Build a model from embedding 🧩 Superchunk 👽 LLM Eval - Salesforce 🍔 Small AMD Model 🔥 Comfy UI 🔥 Molmo is a family of open vision-language models developed by the Allen Institute for AI. Molmo models are trained on PixMo

13. discus

    11 1 64 7.7 Python

    A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ

    

Index

Sponsored

CodeRabbit: AI Code Reviews for Developers

Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

coderabbit.ai

Do not miss the trending Python projects with our weekly report!