Megatron-LM VS TensorRT

Compare Megatron-LM vs TensorRT and see what are their differences.


Ongoing research training transformer models at scale (by NVIDIA)


NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT. (by NVIDIA)
Our great sponsors
  • WorkOS - The modern API for authentication & user identity.
  • Onboard AI - ChatGPT with full context of any GitHub repo.
  • InfluxDB - Power Real-Time Data Analytics at Scale
Megatron-LM TensorRT
17 22
7,829 8,706
5.8% 3.6%
9.8 6.1
7 days ago 19 days ago
Python C++
BSD 3-clause "New" or "Revised" License Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.


Posts with mentions or reviews of Megatron-LM. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-02-23.


Posts with mentions or reviews of TensorRT. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-09-26.

What are some alternatives?

When comparing Megatron-LM and TensorRT you can also consider the following projects:

DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

FasterTransformer - Transformer related optimization, including BERT, GPT

onnx-tensorrt - ONNX-TensorRT: TensorRT backend for ONNX

vllm - A high-throughput and memory-efficient inference and serving engine for LLMs

stable-diffusion-webui - Stable Diffusion web UI

flash-attention - Fast and memory-efficient exact attention

openvino - OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

ColossalAI - Making large AI models cheaper, faster and more accessible

tvm - Open deep learning compiler stack for cpu, gpu and specialized accelerators

tensorrtx - Implementation of popular deep learning networks with TensorRT network definition API

llama.cpp - Port of Facebook's LLaMA model in C/C++