Python pipeline-parallelism

Open-source Python projects categorized as pipeline-parallelism
Edit details
Deep Learning data-parallelism Pytorch Machine Learning Inference
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured

Top 3 Python pipeline-parallelism Projects

pipeline-parallelism

  1. ColossalAI

    Making large AI models cheaper, faster and more accessible

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo

  3. DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    Project mention: All Data and AI Weekly #193 - June 9, 2025 | dev.to | 2025-06-09

  4. petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    Project mention: Petals: Run large language models at home, BitTorrent‑style | news.ycombinator.com | 2025-05-27
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python pipeline-parallelism discussion

Log in or Post with

Python pipeline-parallelism related posts

  • Making large AI models cheaper, faster and more accessible

    1 project | news.ycombinator.com | 21 Mar 2024

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline

    1 project | news.ycombinator.com | 4 Apr 2023

  • Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline

    1 project | /r/machinelearningnews | 1 Apr 2023

  • A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data

    1 project | /r/technology | 30 Mar 2023

  • Colossal-AI: open-source RLHF pipeline based on LLaMA pre-trained model

    1 project | news.ycombinator.com | 29 Mar 2023

  • ColossalChat

    1 project | /r/LocalLLaMA | 29 Mar 2023

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with RLHF Pipeline

    1 project | news.ycombinator.com | 29 Mar 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 18 Jun 2025
    InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →

Index

What are some of the best open-source pipeline-parallelism projects in Python? This list will help you:

# Project Stars
1 ColossalAI 40,971
2 DeepSpeed 38,867
3 petals 9,661

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?

Loading...