InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →
Top 3 Python pipeline-parallelism Projects
-
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Project mention: Petals: Run large language models at home, BitTorrent‑style | news.ycombinator.com | 2025-05-27
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python pipeline-parallelism discussion
Python pipeline-parallelism related posts
-
Making large AI models cheaper, faster and more accessible
-
ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline
-
Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline
-
A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data
-
Colossal-AI: open-source RLHF pipeline based on LLaMA pre-trained model
-
ColossalChat
-
ColossalChat: An Open-Source Solution for Cloning ChatGPT with RLHF Pipeline
-
A note from our sponsor - InfluxDB
www.influxdata.com | 18 Jun 2025
Index
What are some of the best open-source pipeline-parallelism projects in Python? This list will help you:
# | Project | Stars |
---|---|---|
1 | ColossalAI | 40,971 |
2 | DeepSpeed | 38,867 |
3 | petals | 9,661 |