SaaSHub helps you find the best software and product alternatives Learn more →
Top 9 C++ Inference Projects
Cross-platform, customizable ML solutions for live and streaming media.Project mention: MediaPipe is a framework that uses machine learning technologies for real-time object recognition. It was created by Google. | reddit.com/r/callabacloud | 2023-02-07
For more information on how to install and use it, follow the link: https://github.com/google/mediapipe
ncnn is a high-performance neural network inference framework optimized for the mobile platformProject mention: [D] Best way to package Pytorch models as a standalone application | reddit.com/r/MachineLearning | 2023-01-06
They're using NCNN to package the model. Have a look. https://github.com/Tencent/NCNN
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.Project mention: help with project involving object detection and tracking with camera | reddit.com/r/JetsonNano | 2022-06-18
OpenVINO™ Toolkit repositoryProject mention: MMDeploy: Deploy All the Algorithms of OpenMMLab | reddit.com/r/u_Allent_pjlab | 2022-11-21
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source effortsProject mention: What’s New in TensorFlow 2.10? | news.ycombinator.com | 2022-09-06
LightSeq: A High Performance Library for Sequence Processing and Generation
Run TensorFlow models in C++ without installation and without BazelProject mention: Easily run TensorFlow models from C++ | news.ycombinator.com | 2023-01-12
Write Clean C++ Code. Always.. Sonar helps you commit clean C++ code every time. With over 550 unique rules to find C++ bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
This repository is a home to Intel® Deep Learning Streamer (Intel® DL Streamer) Pipeline Framework. Pipeline Framework is a streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines.Project mention: What is the best model and approach to identify a car model? Is a YOLO a good choice for that or is it better to user YOLO or RCNN or darknet for object detection and then use somethin like resnet152 to predict the exact model? | reddit.com/r/computervision | 2022-10-28
If you want object detection, classification (car models in your case) as well as tracking them, before getting your feet wet on model selection viz., Yolo, RCNN etc, check out Intel DLStreamer which uses GStreamer as the back end.... It uses Intel OpenVINO for inferencing and custom plugins for detection/classification and tracking also.... Intel has a big model zoo of pre-trained models, which can do the task of identifying the car models..... https://github.com/dlstreamer/dlstreamer
Fast inference engine for Transformer modelsProject mention: [P] CTranslate2: an efficient inference engine for Transformer models | reddit.com/r/MachineLearning | 2022-05-23
If you'd like to learn more, please visit the GitHub repository and feel free to post questions or suggestions about the project!
C++ Inference related posts
Easily run TensorFlow models from C++
1 project | news.ycombinator.com | 12 Jan 2023
[D] Best way to package Pytorch models as a standalone application
4 projects | reddit.com/r/MachineLearning | 6 Jan 2023
Realtime object detection android app
3 projects | reddit.com/r/learnmachinelearning | 3 Jan 2023
ncnn: High-performance neural network inference framework optimized for mobile
1 project | news.ycombinator.com | 12 Dec 2022
What is the best model and approach to identify a car model? Is a YOLO a good choice for that or is it better to user YOLO or RCNN or darknet for object detection and then use somethin like resnet152 to predict the exact model?
1 project | reddit.com/r/computervision | 28 Oct 2022
What’s New in TensorFlow 2.10?
4 projects | news.ycombinator.com | 6 Sep 2022
[P] What we learned by making T5-large 2X faster than Pytorch (and any autoregressive transformer)
6 projects | reddit.com/r/MachineLearning | 23 May 2022
A note from our sponsor - #<SponsorshipServiceOld:0x00007fea59dbf498>
www.saashub.com | 8 Feb 2023
What are some of the best open-source Inference projects in C++? This list will help you: