Get non-trivial tests (and trivial, too!) suggested right inside your IDE, so you can code smart, create more value, and stay confident when you push. Learn more →
Python data-parallelism Projects
-
Project mention: ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline | news.ycombinator.com | 2023-04-04
> open-source a complete RLHF pipeline ... based on the LLaMA pre-trained model
I've gotten to where when I see "open source AI" I now know it's "well, except for $some_other_dependencies"
Anyway: https://scribe.rip/@yangyou_berkeley/colossalchat-an-open-so... and https://github.com/hpcaitech/ColossalAI#readme (Apache 2) can save you some medium.com heartache at least
-
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Project mention: Using --deepspeed requires lots of manual tweaking | reddit.com/r/Oobabooga | 2023-05-11Filed a discussion item on the deepspeed project: https://github.com/microsoft/DeepSpeed/discussions/3531
-
InfluxDB
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
Python data-parallelism related posts
- ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline
- Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline
- A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data
- Colossal-AI: open-source RLHF pipeline based on LLaMA pre-trained model
- ColossalChat
- ColossalChat: An Open-Source Solution for Cloning ChatGPT with RLHF Pipeline
- Open source solution replicates ChatGPT training process
-
A note from our sponsor - CodiumAI
codium.ai | 29 May 2023
Index
Project | Stars | |
---|---|---|
1 | ColossalAI | 29,867 |
2 | DeepSpeed | 25,088 |