Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
billion-parameter Open-Source Projects
-
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: Can we discuss MLOps, Deployment, Optimizations, and Speed? | /r/LocalLLaMA | 2023-12-06DeepSpeed can handle parallelism concerns, and even offload data/model to RAM, or even NVMe (!?) . I'm surprised I don't see this project used more.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
billion-parameters related posts
-
[P][D] A100 is much slower than expected at low batch size for text generation
-
DeepSpeed-FastGen: High-Throughput for LLMs via MII and DeepSpeed-Inference
-
DeepSpeed-FastGen: High-Throughput Text Generation for LLMs
-
Why async gradient update doesn't get popular in LLM community?
-
DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models (r/MachineLearning)
-
[P] DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
-
Using --deepspeed requires lots of manual tweaking
-
A note from our sponsor - InfluxDB
www.influxdata.com | 4 May 2024
Index
Project | Stars | |
---|---|---|
1 | DeepSpeed | 32,739 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com