Python pipeline-parallelism

Open-source Python projects categorized as pipeline-parallelism
Edit details
Deep Learning Pytorch Machine Learning Inference data-parallelism
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 3 Python pipeline-parallelism Projects

Python logo
pipeline-parallelism

  1. DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    Project mention: AWS SageMaker HyperPod: Distributed Training for Foundation Models at Scale | dev.to | 2026-01-16

    DeepSpeed Optimization Library - An open-source library compatible with HyperPod that offers advanced pipeline and system optimizations for LLM training.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. ColossalAI

    Making large AI models cheaper, faster and more accessible

  4. petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python pipeline-parallelism discussion

Log in or Post with

Python pipeline-parallelism related posts

  • Making large AI models cheaper, faster and more accessible

    1 project | news.ycombinator.com | 21 Mar 2024

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline

    1 project | news.ycombinator.com | 4 Apr 2023

  • Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline

    1 project | /r/machinelearningnews | 1 Apr 2023

  • A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data

    1 project | /r/technology | 30 Mar 2023

  • Colossal-AI: open-source RLHF pipeline based on LLaMA pre-trained model

    1 project | news.ycombinator.com | 29 Mar 2023

  • ColossalChat

    1 project | /r/LocalLLaMA | 29 Mar 2023

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with RLHF Pipeline

    1 project | news.ycombinator.com | 29 Mar 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 9 Jun 2026
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source pipeline-parallelism projects in Python? This list will help you:

# Project Stars
1 DeepSpeed 42,461
2 ColossalAI 41,385
3 petals 10,171

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...