Megatron-LM VS DeepLearningExamples

Compare Megatron-LM vs DeepLearningExamples and see what are their differences.


Ongoing research training transformer models at scale (by NVIDIA)


State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure. (by NVIDIA)
Our great sponsors
  • InfluxDB - Collect and Analyze Billions of Data Points in Real Time
  • Onboard AI - Learn any GitHub repo in 59 seconds
  • SaaSHub - Software Alternatives and Reviews
Megatron-LM DeepLearningExamples
15 7
6,877 11,741
6.5% 2.0%
0.0 0.0
10 days ago 21 days ago
Python Jupyter Notebook
BSD 3-clause "New" or "Revised" License -
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.


Posts with mentions or reviews of Megatron-LM. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-10-10.


Posts with mentions or reviews of DeepLearningExamples. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-01-19.

What are some alternatives?

When comparing Megatron-LM and DeepLearningExamples you can also consider the following projects:

DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

ColossalAI - Making large AI models cheaper, faster and more accessible

TensorRT - NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

server - The Triton Inference Server provides an optimized cloud and edge inferencing solution.

lidar-harmonization - Code release for Intensity Harmonization for Airborne LiDAR

llm-search - Querying local documents, powered by LLM

pix2seq - Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)

alpaca_eval - An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

ontogpt - LLM-based ontological extraction tools, including SPIRES

ChatGPT-Siri - Shortcuts for Siri using ChatGPT API gpt-3.5-turbo & gpt-4 model, supports continuous conversations, configure the API key & save chat records. 由 ChatGPT API gpt-3.5-turbo & gpt-4 模型驱动的智能 Siri,支持连续对话,配置API key,配置系统prompt,保存聊天记录。

AutoCog - Automaton & Cognition

notebooks - Notebooks illustrating the use of Norse, a library for deep-learning with spiking neural networks.