Top 12 Python preprocessing Projects

ragflow

6 5,516 9.5 Python

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Project mention: RAGFlow is an open-source RAG engine based on deep document understanding | news.ycombinator.com | 2024-04-01

Just link them to https://github.com/infiniflow/ragflow/blob/main/rag/llm/chat... :)

igel

11 3,080 1.1 Python

a delightful machine learning tool that allows you to train, test, and use models without writing code
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
MLBox

1 1,475 0.0 Python

MLBox is a powerful Automated Machine Learning python library.
NVTabular

1 1,004 5.5 Python

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
nnAudio

1 953 5.3 Python

Audio processing by using pytorch 1D convolution network
voicesmith

1 207 10.0 Python

[WIP] VoiceSmith makes training text to speech models easy.
pytorch-VideoDataset

1 67 0.0 Python

Tools for loading video dataset and transforms on video in pytorch. You can directly load video files without preprocessing.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
courlan

0 65 7.4 Python

Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters
podium

1 60 0.0 Python

Podium: a framework agnostic Python NLP library for data loading and preprocessing
cpip

1 38 3.7 Python

CPIP - a C/C++ preprocessor implemented in Python.
VHDLproc

1 24 0.0 Python

VHDLproc is a VHDL preprocessor
riffusion-scripts

1 0 5.3 Python

Scripts to aid in preparing training data for riffusion.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python preprocessing related posts

LEAF: A Learnable Frontend for Audio Classification
1 project | /r/speechtech | 26 Jan 2021

Index

What are some of the best open-source preprocessing projects in Python? This list will help you:

	Project	Stars
1	ragflow	5,516
2	igel	3,080
3	MLBox	1,475
4	NVTabular	1,004
5	nnAudio	953
6	voicesmith	207
7	pytorch-VideoDataset	67
8	courlan	65
9	podium	60
10	cpip	38
11	VHDLproc	24
12	riffusion-scripts	0