SaaSHub helps you find the best software and product alternatives Learn more →
DeepSpeedExamples Alternatives
Similar projects and alternatives to DeepSpeedExamples
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better DeepSpeedExamples alternative or higher similarity.
DeepSpeedExamples reviews and mentions
Posts with mentions or reviews of DeepSpeedExamples.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-18.
-
[R] 🚀🧠 Introducing 3 New LoRA Models Trained with LLaMA on the OASST Dataset at 2048 seq length! 📊🔥
Microsoft recently launched something called deepspeed chat which should speed up the rlhf process a good bit. So hopefully we will start seeing those soon. We are working on some now that we will open source on completion!
-
DeepSpeed Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like Models
Also see the example repo README: https://github.com/microsoft/DeepSpeedExamples/tree/master/a...
> With just one click, you can train, generate and serve a 1.3 billion parameter ChatGPT model within 1.36 hours on a single consumer-grade NVIDIA A6000 GPU with 48GB memory. On a single DGX node with 8 NVIDIA A100-40G GPUs, DeepSpeed-Chat enables training for a 13 billion parameter ChatGPT model in 13.6 hours. On multi-GPU multi-node systems (cloud scenarios),i.e., 8 DGX nodes with 8 NVIDIA A100 GPUs/node, DeepSpeed-Chat can train a 66 billion parameter ChatGPT model under 9 hours. Finally, it enables 15X faster training over the existing RLHF systems
> The following are some of the open-source examples that are powered by DeepSpeed: Databricks Dolly, LMFlow, CarperAI-TRLX, Huggingface-PEFT
(disclaimer: MSFT/GH employee, not affiliated with this project)
-
Databricks Releases 15K Record Training Corpus for Instruction Tuning LLMs
can you compare your dolly offering with https://github.com/microsoft/DeepSpeedExamples/blob/master/a...
- DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like Models
-
Microsoft DeepSpeed
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales https://github.com/microsoft/DeepSpeedExamples/tree/master/a...
-
A note from our sponsor - SaaSHub
www.saashub.com | 3 May 2024
Stats
Basic DeepSpeedExamples repo stats
5
5,688
8.7
2 days ago
microsoft/DeepSpeedExamples is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of DeepSpeedExamples is Python.
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com