SaaSHub helps you find the best software and product alternatives Learn more →
Top 12 C++ Tensorrt Projects
-
TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
Extensions: Jan supports extensions like TensortRT and Inference Nitro for customizing and enhancing your AI models.
-
InfluxDB
InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.
-
jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
-
-
TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts
-
FastDeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
-
-
deepdetect
Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
-
-
-
-
vs-mlrt
Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
C++ Tensorrt discussion
C++ Tensorrt related posts
-
AMD MI300X 30% higher performance than Nvidia H100, even with optimized stack
-
Getting SDXL-turbo running with tensorRT
-
Nvidia Introduces TensorRT-LLM for Accelerating LLM Inference on H100/A100 GPUs
-
Train Your AI Model Once and Deploy on Any Cloud
-
WIP - TensorRT accelerated stable diffusion img2img from mobile camera over webrtc + whisper speech to text. Interdimensional cable is here! Code: https://github.com/venetanji/videosd
-
Speeding up T5
-
demoDiffusion on TensorRT - supports 3090, 4090, and A100
-
A note from our sponsor - SaaSHub
www.saashub.com | 23 Apr 2025
Index
What are some of the best open-source Tensorrt projects in C++? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | TensorRT | 11,478 |
| 2 | jetson-inference | 8,241 |
| 3 | tensorrtx | 7,303 |
| 4 | TNN | 4,495 |
| 5 | FastDeploy | 3,157 |
| 6 | tensorRT_Pro | 2,683 |
| 7 | deepdetect | 2,531 |
| 8 | Stable-Diffusion-NCNN | 1,030 |
| 9 | tensorrt-cpp-api | 693 |
| 10 | YOLOv8-TensorRT-CPP | 631 |
| 11 | yolov5-deepsort-tensorrt | 469 |
| 12 | vs-mlrt | 342 |
Sponsored
InfluxDB high-performance time series database
Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.
influxdata.com