DeepSpeed VS gpt-neox

Compare DeepSpeed vs gpt-neox and see what are their differences.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. (by microsoft)

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries (by EleutherAI)
Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
DeepSpeed gpt-neox
51 53
33,850 6,718
2.2% 1.2%
9.8 8.9
8 days ago 9 days ago
Python Python
Apache License 2.0 Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

DeepSpeed

Posts with mentions or reviews of DeepSpeed. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-12-06.

gpt-neox

Posts with mentions or reviews of gpt-neox. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-06-03.

What are some alternatives?

When comparing DeepSpeed and gpt-neox you can also consider the following projects:

ColossalAI - Making large AI models cheaper, faster and more accessible

fairseq - Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Megatron-LM - Ongoing research training transformer models at scale

gpt-neo - An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

fairscale - PyTorch extensions for high performance and large scale training.

YaLM-100B - Pretrained language model with 100B parameters

TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

open-ai - OpenAI PHP SDK : Most downloaded, forked, contributed, huge community supported, and used PHP (Laravel , Symfony, Yii, Cake PHP or any PHP framework) SDK for OpenAI GPT-3 and DALL-E. It also supports chatGPT-like streaming. (ChatGPT AI is supported)

accelerate - 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

lm-evaluation-harness - A framework for few-shot evaluation of language models.

Megatron-DeepSpeed - Ongoing research training transformer language models at scale, including: BERT & GPT-2

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured