SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 C++ Pytorch Projects
-
ncnn
ncnn is a high-performance neural network inference framework optimized for the mobile platform
Project mention: AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source | news.ycombinator.com | 2024-02-12ncnn uses Vulkan for GPU acceleration, I've seen it used in a few projects to get AMD hardware support.
-
Embedding generation uses the ONNX runtime under the hood. This is a cross-platform inferencing library that supports multiple execution providers from CPU to specialized GPUs.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Project mention: Does anyone else agree that the links to the latest development version of Open3D don't work? | /r/cscareerquestions | 2023-07-10
I was going to file a bug about another issue, but I have to download the development version. This is why I want this solved quickly. None of the links seem to work: https://github.com/isl-org/Open3D/issues/6259
-
Project mention: Train Your AI Model Once and Deploy on Any Cloud | news.ycombinator.com | 2023-07-08
https://docs.nvidia.com/ai-enterprise/overview/0.1.0/platfor...
RIVA: NVIDIA® Riva, a premium edition of NVIDIA AI Enterprise software, is a GPU-accelerated speech and translation AI SDK
FasterTransformer: https://github.com/NVIDIA/FasterTransformer an
-
DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
Another option is DALI https://github.com/NVIDIA/DALI For my project while training EfficientNet2, it was a game changer. But it a way harder to implement in code than TorchVision or Kornia.
-
TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
deepdetect
Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
Project mention: Exploring Open-Source Alternatives to Landing AI for Robust MLOps | dev.to | 2023-12-13For those seeking a lightweight solution for setting up deep learning REST APIs across platforms without the complexity of Kubernetes, Deepdetect is worth considering.
-
Project mention: Calyx, a Compiler Infrastructure for Accelerator Generators | news.ycombinator.com | 2024-03-04
How is this different than the mlir infrastructure of llvm and xla implemented in https://iree.dev/?
-
-
Project mention: Who uses Google TPUs for inference in production? | news.ycombinator.com | 2024-03-11
> The PyTorch/XLA Team at Google
Meanwhile you have an issue from 5 years ago with 0 support
-
EdgeML
This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India. (by microsoft)
-
torch-mlir
The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.
Project mention: Pytorch with AMD Radeon RX 6950 XT GPU: Is it possible on Windows 11? | /r/pytorch | 2023-05-13You're best option is to use torchmlir : https://github.com/llvm/torch-mlir
-
-
Project mention: For those interested in learning how to build a Language Identification solution using PyTorch, check out my article. | /r/learnmachinelearning | 2023-04-28
Link to code sample: https://github.com/oneapi-src/oneAPI-samples/tree/master/AI-and-Analytics/End-to-end-Workloads/LanguageIdentification
-
-
Yes, see "DREAMPlace: DREAMPlace: Deep Learning Toolkit-Enabled GPU Acceleration for Modern VLSI Placement".[1] The technique in particular rather reformulates VLSI placement in terms of a non-linear optimization problem. Which is how ML frameworks (broadly) work, optimizing approximations to high-dimensional non-linear functions. So it's not like, shoving the netlist it into an LLM or an existing network or anything.
Note that DREAMPlace is a global placer; it also comes with a detail placer but global placement is what it is targeted at. I don't know of an appropriate research analogue for the routing phase of the problem that follows placing, but maybe someone else does.
-
Few-Shot-Patch-Based-Training
The official implementation of our SIGGRAPH 2020 paper Interactive Video Stylization Using Few-Shot Patch-Based Training
-
SegmentationCpp
A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.
-
-
iSeeBetter
iSeeBetter: Spatio-Temporal Video Super Resolution using Recurrent-Generative Back-Projection Networks | Python3 | PyTorch | GANs | CNNs | ResNets | RNNs | Published in Springer Journal of Computational Visual Media, September 2020, Tsinghua University Press
-
PercepNet
Unofficial implementation of PercepNet: A Perceptually-Motivated Approach for Low-Complexity, Real-Time Enhancement of Fullband Speech
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2024-04-16.
C++ Pytorch related posts
- Who uses Google TPUs for inference in production?
- AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source
- Google TPU v5p beats Nvidia H100
- A Simulated Annealing FPGA Placer in Rust
- Hackers manage to unlock Tesla software-locked features
- Train Your AI Model Once and Deploy on Any Cloud
- Is there any way to upscale local files permanently using Nvidia's RT VSR?
-
A note from our sponsor - SaaSHub
www.saashub.com | 18 Apr 2024
Index
What are some of the best open-source Pytorch projects in C++? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | ncnn | 19,125 |
| 2 | onnxruntime | 12,583 |
| 3 | Open3D | 10,436 |
| 4 | FasterTransformer | 5,411 |
| 5 | DALI | 4,902 |
| 6 | TNN | 4,277 |
| 7 | onnx-simplifier | 3,531 |
| 8 | tiny-cuda-nn | 3,360 |
| 9 | deepdetect | 2,493 |
| 10 | iree | 2,376 |
| 11 | tensorRT_Pro | 2,350 |
| 12 | xla | 2,285 |
| 13 | EdgeML | 1,537 |
| 14 | torch-mlir | 1,168 |
| 15 | hls4ml | 1,089 |
| 16 | oneAPI-samples | 830 |
| 17 | LibtorchTutorials | 639 |
| 18 | DREAMPlace | 614 |
| 19 | Few-Shot-Patch-Based-Training | 603 |
| 20 | SegmentationCpp | 400 |
| 21 | nimblephysics | 379 |
| 22 | iSeeBetter | 348 |
| 23 | PercepNet | 302 |
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com