data-parallelism

Open-source projects categorized as data-parallelism
Edit details
Language: + Python + Nim
Topics: Deep Learning Inference model-parallelism pipeline-parallelism mixture-of-experts
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 3 data-parallelism Open-Source Projects

  • ColossalAI

    Making large AI models cheaper, faster and more accessible

    • Project mention: FLaNK AI-April 22, 2024 | dev.to | 2024-04-22

  • DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    • Project mention: Can we discuss MLOps, Deployment, Optimizations, and Speed? | /r/LocalLLaMA | 2023-12-06

    DeepSpeed can handle parallelism concerns, and even offload data/model to RAM, or even NVMe (!?) . I'm surprised I don't see this project used more.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • weave

    A state-of-the-art multithreading runtime: message-passing based, fast, scalable, ultra-low overhead (by mratsim)

    • Project mention: The GIL can now be disabled in Python's main branch | news.ycombinator.com | 2024-03-11
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

data-parallelism related posts

  • Making large AI models cheaper, faster and more accessible

    1 project | news.ycombinator.com | 21 Mar 2024

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline

    1 project | news.ycombinator.com | 4 Apr 2023

  • Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline

    1 project | /r/machinelearningnews | 1 Apr 2023

  • A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data

    1 project | /r/technology | 30 Mar 2023

  • Colossal-AI: open-source RLHF pipeline based on LLaMA pre-trained model

    1 project | news.ycombinator.com | 29 Mar 2023

  • ColossalChat

    1 project | /r/LocalLLaMA | 29 Mar 2023

  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with RLHF Pipeline

    1 project | news.ycombinator.com | 29 Mar 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 5 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source data-parallelism projects? This list will help you:

Project Stars
1 ColossalAI 37,911
2 DeepSpeed 32,739
3 weave 523

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com