SaaSHub helps you find the best software and product alternatives Learn more →
Top 9 C++ Inference Projects
-
Project mention: MediaPipe is a framework that uses machine learning technologies for real-time object recognition. It was created by Google. | reddit.com/r/callabacloud | 2023-02-07
For more information on how to install and use it, follow the link: https://github.com/google/mediapipe
-
ncnn
ncnn is a high-performance neural network inference framework optimized for the mobile platform
Project mention: [D] Best way to package Pytorch models as a standalone application | reddit.com/r/MachineLearning | 2023-01-06They're using NCNN to package the model. Have a look. https://github.com/Tencent/NCNN
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
-
jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
Project mention: help with project involving object detection and tracking with camera | reddit.com/r/JetsonNano | 2022-06-18 -
Project mention: MMDeploy: Deploy All the Algorithms of OpenMMLab | reddit.com/r/u_Allent_pjlab | 2022-11-21
OpenVINO
-
TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts
-
-
-
Sonar
Write Clean C++ Code. Always.. Sonar helps you commit clean C++ code every time. With over 550 unique rules to find C++ bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
dlstreamer
This repository is a home to Intel® Deep Learning Streamer (Intel® DL Streamer) Pipeline Framework. Pipeline Framework is a streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines.
Project mention: What is the best model and approach to identify a car model? Is a YOLO a good choice for that or is it better to user YOLO or RCNN or darknet for object detection and then use somethin like resnet152 to predict the exact model? | reddit.com/r/computervision | 2022-10-28If you want object detection, classification (car models in your case) as well as tracking them, before getting your feet wet on model selection viz., Yolo, RCNN etc, check out Intel DLStreamer which uses GStreamer as the back end.... It uses Intel OpenVINO for inferencing and custom plugins for detection/classification and tracking also.... Intel has a big model zoo of pre-trained models, which can do the task of identifying the car models..... https://github.com/dlstreamer/dlstreamer
-
Project mention: [P] CTranslate2: an efficient inference engine for Transformer models | reddit.com/r/MachineLearning | 2022-05-23
If you'd like to learn more, please visit the GitHub repository and feel free to post questions or suggestions about the project!
C++ Inference related posts
- Easily run TensorFlow models from C++
- [D] Best way to package Pytorch models as a standalone application
- Realtime object detection android app
- ncnn: High-performance neural network inference framework optimized for mobile
- What is the best model and approach to identify a car model? Is a YOLO a good choice for that or is it better to user YOLO or RCNN or darknet for object detection and then use somethin like resnet152 to predict the exact model?
- What’s New in TensorFlow 2.10?
- [P] What we learned by making T5-large 2X faster than Pytorch (and any autoregressive transformer)
-
A note from our sponsor - #<SponsorshipServiceOld:0x00007fea59dbf498>
www.saashub.com | 8 Feb 2023
Index
What are some of the best open-source Inference projects in C++? This list will help you:
Project | Stars | |
---|---|---|
1 | mediapipe | 20,311 |
2 | ncnn | 16,344 |
3 | jetson-inference | 6,116 |
4 | openvino | 3,960 |
5 | TNN | 3,825 |
6 | lightseq | 2,572 |
7 | cppflow | 685 |
8 | dlstreamer | 425 |
9 | CTranslate2 | 411 |