Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Python data-parallelism Projects
-
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Project mention: Can we discuss MLOps, Deployment, Optimizations, and Speed? | /r/LocalLLaMA | 2023-12-06DeepSpeed can handle parallelism concerns, and even offload data/model to RAM, or even NVMe (!?) . I'm surprised I don't see this project used more.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python data-parallelism related posts
- Making large AI models cheaper, faster and more accessible
- ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline
- Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline
- A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data
- Colossal-AI: open-source RLHF pipeline based on LLaMA pre-trained model
- ColossalChat
- ColossalChat: An Open-Source Solution for Cloning ChatGPT with RLHF Pipeline
-
A note from our sponsor - InfluxDB
www.influxdata.com | 24 Apr 2024
Index
Project | Stars | |
---|---|---|
1 | ColossalAI | 37,836 |
2 | DeepSpeed | 32,550 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com