Python data-parallelism

Open-source Python projects categorized as data-parallelism
Edit details
model-parallelism pipeline-parallelism Inference Deep Learning Machine Learning
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Python data-parallelism Projects

data-parallelism

  1. ColossalAI

    Making large AI models cheaper, faster and more accessible

  2. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo

  3. DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    Project mention: All Data and AI Weekly #193 - June 9, 2025 | dev.to | 2025-06-09
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python data-parallelism discussion

Log in or Post with

Python data-parallelism related posts

  • Making large AI models cheaper, faster and more accessible

    1 project | news.ycombinator.com | 21 Mar 2024

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline

    1 project | news.ycombinator.com | 4 Apr 2023

  • Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline

    1 project | /r/machinelearningnews | 1 Apr 2023

  • A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data

    1 project | /r/technology | 30 Mar 2023

  • Colossal-AI: open-source RLHF pipeline based on LLaMA pre-trained model

    1 project | news.ycombinator.com | 29 Mar 2023

  • ColossalChat

    1 project | /r/LocalLLaMA | 29 Mar 2023

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with RLHF Pipeline

    1 project | news.ycombinator.com | 29 Mar 2023
  • A note from our sponsor - Stream
    getstream.io | 18 Jul 2025
    Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure. Learn more →

Index

# Project Stars
1 ColossalAI 41,034
2 DeepSpeed 39,335

Sponsored
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video.
Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
getstream.io
Loading...