DeepSpeed Alternatives

Similar projects and alternatives to DeepSpeed

• Megatron-LM

  3 7,029 0.0 Python DeepSpeed VS Megatron-LM

  Ongoing research training transformer models at scale

  

• fairscale

  2 2,646 0.0 Python DeepSpeed VS fairscale

  PyTorch extensions for high performance and large scale training.

  

• InfluxDB

  www.influxdata.com

  sponsored

  Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  

• llama

  7 46,328 8.7 Python DeepSpeed VS llama

  Inference code for LLaMA models

  

• ColossalAI

  - 35,495 0.0 Python DeepSpeed VS ColossalAI

  Making large AI models cheaper, faster and more accessible

  

• accelerate

  1 6,065 9.2 Python DeepSpeed VS accelerate

  🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

  

• TensorRT

  - 8,246 7.4 C++ DeepSpeed VS TensorRT

  NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

  

• llama.cpp

  6 45,354 9.7 C DeepSpeed VS llama.cpp

  Port of Facebook's LLaMA model in C/C++

• Onboard AI

  getonboard.dev

  sponsored

  Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  

• mesh-transformer-jax

  1 6,146 0.0 Python DeepSpeed VS mesh-transformer-jax

  Model parallel transformers in JAX and Haiku

• fairseq

  - 28,143 7.9 Python DeepSpeed VS fairseq

  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

  

• text-generation-webui

  4 28,173 9.9 Python DeepSpeed VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• stable-diffusion-webui

  3 110,759 9.9 Python DeepSpeed VS stable-diffusion-webui

  Stable Diffusion web UI

• petals

  3 7,979 8.6 Python DeepSpeed VS petals

  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  

• gpt-neox

  3 6,207 0.0 Python DeepSpeed VS gpt-neox

  An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

  

• DeepSpeedExamples

  3 5,165 8.8 Python DeepSpeed VS DeepSpeedExamples

  Example models using DeepSpeed

  

• Pytorch

  2 72,946 10.0 Python DeepSpeed VS Pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  

• ollama

  2 19,419 10.0 Go DeepSpeed VS ollama

  Get up and running with Llama 2 and other large language models locally

• AnimatedDrawings

  2 9,748 7.3 Python DeepSpeed VS AnimatedDrawings

  Code to accompany "A Method for Animating Children's Drawings of the Human Figure"

  

• FlexGen

  2 8,689 8.0 Python DeepSpeed VS FlexGen

  Running large language models on a single GPU for throughput-oriented scenarios.

  

• diffusers

  2 1,840 9.2 Python DeepSpeed VS diffusers

  🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch (by ShivamShrirao)

• phasellm

  2 426 10.0 Python DeepSpeed VS phasellm

  Large language model evaluation and workflow framework from Phase AI.

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives