C++ Pytorch

Open-source C++ projects categorized as Pytorch

Top 23 C++ Pytorch Projects

  1. ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    Project mention: OpenMP 6.0 | news.ycombinator.com | 2024-11-14
  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. onnxruntime

    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

    Project mention: Generative AI Interview for Senior Data Scientists: 50 Key Questions and Answers | dev.to | 2025-05-06

    How it works: A model trained in one framework can be converted to the ONNX format. This format can then be run on various hardware or inference engines that support it (e.g., ONNX Runtime). It facilitates easy model transfer and execution even if the development framework and deployment environment differ.

  4. Open3D

    Open3D: A Modern Library for 3D Data Processing

  5. FasterTransformer

    Transformer related optimization, including BERT, GPT

  6. DALI

    A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

    Project mention: Essential Deep Learning Checklist: Best Practices Unveiled | dev.to | 2024-06-17

    How to Accomplish: Use a combination of geometric transformations (e.g., rotation, scaling, cropping, flipping), color space adjustments (e.g., brightness, contrast, saturation), and other techniques (e.g., noise injection, blurring, cutout). Libraries such as ImgAug, DeepMind Augmentation, Albumentations, and NVIDIA DALI offer a wide range of ready-to-use augmentation techniques that can introduce the necessary diversity into your dataset.

  7. TNN

    TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts

  8. onnx-simplifier

    Simplify your onnx model

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. tiny-cuda-nn

    Lightning fast C++/CUDA neural network framework

  11. iree

    A retargetable MLIR-based machine learning compiler and runtime toolkit.

    Project mention: IREE | news.ycombinator.com | 2025-04-23
  12. tensorRT_Pro

    C++ library based on tensorrt integration

  13. deepdetect

    Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

  14. EdgeML

    This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India. (by microsoft)

  15. torch-mlir

    The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

  16. hls4ml

    Machine learning on FPGAs using HLS

  17. oneAPI-samples

    Samples for Intel® oneAPI Toolkits

  18. DREAMPlace

    Deep learning toolkit-enabled VLSI placement

  19. LibtorchTutorials

    This is a code repository for pytorch c++ (or libtorch) tutorial.

  20. Few-Shot-Patch-Based-Training

    The official implementation of our SIGGRAPH 2020 paper Interactive Video Stylization Using Few-Shot Patch-Based Training

  21. nimblephysics

    Nimble: Physics Engine for Biomechanics and Deep Learning

  22. SegmentationCpp

    A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.

  23. nnue-pytorch

    Stockfish NNUE (Chess evaluation) trainer in Pytorch

  24. iSeeBetter

    iSeeBetter: Spatio-Temporal Video Super Resolution using Recurrent-Generative Back-Projection Networks | Python3 | PyTorch | GANs | CNNs | ResNets | RNNs | Published in Springer Journal of Computational Visual Media, September 2020, Tsinghua University Press

  25. pytorch_dlprim

    DLPrimitives/OpenCL out of tree backend for pytorch

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Pytorch discussion

Log in or Post with

C++ Pytorch related posts

  • AI Model Optimization on AWS Inferentia and Trainium

    1 project | dev.to | 3 Nov 2024
  • Grandmaster-Level Chess Without Search

    9 projects | news.ycombinator.com | 17 Oct 2024
  • Training AI Models on CPU on AWS EC2

    5 projects | dev.to | 4 Sep 2024
  • An Interview with AMD CEO Lisa Su About Solving Hard Problems

    8 projects | news.ycombinator.com | 17 Jun 2024
  • Haystack DB – 10x faster than FAISS with binary embeddings by default

    3 projects | news.ycombinator.com | 28 Apr 2024
  • Who uses Google TPUs for inference in production?

    1 project | news.ycombinator.com | 11 Mar 2024
  • AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source

    23 projects | news.ycombinator.com | 12 Feb 2024
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 14 May 2025
    InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →

Index

What are some of the best open-source Pytorch projects in C++? This list will help you:

# Project Stars
1 ncnn 21,437
2 onnxruntime 16,538
3 Open3D 12,269
4 FasterTransformer 6,089
5 DALI 5,383
6 TNN 4,505
7 onnx-simplifier 4,070
8 tiny-cuda-nn 4,003
9 iree 3,119
10 tensorRT_Pro 2,683
11 deepdetect 2,535
12 EdgeML 1,614
13 torch-mlir 1,523
14 hls4ml 1,470
15 oneAPI-samples 1,030
16 DREAMPlace 798
17 LibtorchTutorials 783
18 Few-Shot-Patch-Based-Training 625
19 nimblephysics 440
20 SegmentationCpp 439
21 nnue-pytorch 389
22 iSeeBetter 368
23 pytorch_dlprim 346

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that C++ is
the 7th most popular programming language
based on number of references?