C++ Inference

Open-source C++ projects categorized as Inference
Edit details
Topics: #Deep Learning #Openvino #Tensorflow #CPP #Machine Learning
Write Clean C++ Code. Always.
Sonar helps you commit clean C++ code every time. With over 550 unique rules to find C++ bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
www.sonarsource.com
Sponsored

Top 9 C++ Inference Projects

  • mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

    Project mention: MediaPipe is a framework that uses machine learning technologies for real-time object recognition. It was created by Google. | reddit.com/r/callabacloud | 2023-02-07

    For more information on how to install and use it, follow the link: https://github.com/google/mediapipe

  • ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    Project mention: [D] Best way to package Pytorch models as a standalone application | reddit.com/r/MachineLearning | 2023-01-06

    They're using NCNN to package the model. Have a look. https://github.com/Tencent/NCNN

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.

  • jetson-inference

    Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

    Project mention: help with project involving object detection and tracking with camera | reddit.com/r/JetsonNano | 2022-06-18

  • openvino

    OpenVINO™ Toolkit repository

    Project mention: MMDeploy: Deploy All the Algorithms of OpenMMLab | reddit.com/r/u_Allent_pjlab | 2022-11-21

    OpenVINO

  • TNN

    TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts

    Project mention: What’s New in TensorFlow 2.10? | news.ycombinator.com | 2022-09-06

  • lightseq

    LightSeq: A High Performance Library for Sequence Processing and Generation

  • cppflow

    Run TensorFlow models in C++ without installation and without Bazel

    Project mention: Easily run TensorFlow models from C++ | news.ycombinator.com | 2023-01-12

  • Sonar

    Write Clean C++ Code. Always.. Sonar helps you commit clean C++ code every time. With over 550 unique rules to find C++ bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • dlstreamer

    This repository is a home to Intel® Deep Learning Streamer (Intel® DL Streamer) Pipeline Framework. Pipeline Framework is a streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines.

    Project mention: What is the best model and approach to identify a car model? Is a YOLO a good choice for that or is it better to user YOLO or RCNN or darknet for object detection and then use somethin like resnet152 to predict the exact model? | reddit.com/r/computervision | 2022-10-28

    If you want object detection, classification (car models in your case) as well as tracking them, before getting your feet wet on model selection viz., Yolo, RCNN etc, check out Intel DLStreamer which uses GStreamer as the back end.... It uses Intel OpenVINO for inferencing and custom plugins for detection/classification and tracking also.... Intel has a big model zoo of pre-trained models, which can do the task of identifying the car models..... https://github.com/dlstreamer/dlstreamer

  • CTranslate2

    Fast inference engine for Transformer models

    Project mention: [P] CTranslate2: an efficient inference engine for Transformer models | reddit.com/r/MachineLearning | 2022-05-23

    If you'd like to learn more, please visit the GitHub repository and feel free to post questions or suggestions about the project!

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-02-07.

C++ Inference related posts

Index

What are some of the best open-source Inference projects in C++? This list will help you:

Project Stars
1 mediapipe 20,311
2 ncnn 16,344
3 jetson-inference 6,116
4 openvino 3,960
5 TNN 3,825
6 lightseq 2,572
7 cppflow 685
8 dlstreamer 425
9 CTranslate2 411

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com