C++ Deep Learning

Open-source C++ projects categorized as Deep Learning

Top 23 C++ Deep Learning Projects

  • tensorflow

    An Open Source Machine Learning Framework for Everyone

    Project mention: How worried are you about AI taking over music? | reddit.com/r/WeAreTheMusicMakers | 2023-02-03

    Tensorflow 238k contributors

  • OpenCV

    Open Source Computer Vision Library

    Project mention: Real time images to Arduino Arrays conversion for use on LCD displays? | reddit.com/r/arduino | 2023-02-03

    To capture your eyes and make the determination of whether they are open or not (or to even copy the images to the LCD in realtime) will require a processor running much much faster than the average Arduino. Probably something making use of openCV (an extremely capable open source Computer Vision and image processing library). Arduino's (most) run at 16MHz. A Raspberry Pi or an ESP32 would be much more suited to capturing the camera frames and doing something with the image data in realtime since they run in the GHz and 240MHz range respectively.

  • Sonar

    Write Clean C++ Code. Always.. Sonar helps you commit clean C++ code every time. With over 550 unique rules to find C++ bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

    Project mention: How worried are you about AI taking over music? | reddit.com/r/WeAreTheMusicMakers | 2023-02-03

    PyTorch 2,600 contributors

  • Caffe

    Caffe: a fast open framework for deep learning.

    Project mention: German ad: "Artificial intelligence: the 4 most used drinks will be placed on the main screen" | reddit.com/r/ProgrammerHumor | 2022-09-20
  • openpose

    OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

    Project mention: nub needs some directions | reddit.com/r/tensorflow | 2023-01-26
  • DeepSpeech

    DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

    Project mention: My matrix bot that transcribes speech in audio messages | news.ycombinator.com | 2022-12-12

    Mozilla has an open source tect-to-speech project, called deep speech.


  • mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

    Project mention: Consistent Animation Test with Textual Inversion | reddit.com/r/StableDiffusion | 2022-10-19

    It might be kind of insane, but if you have the programming ability in theory you might be able to use mediapipe to calculate a per frame face mesh. Then store the mesh oriented bounding box and for each frame output a transformed image such that all the faces overlap. Then feed the new images into Stable Diffusion and feed that image into an inverse transform and use that final image to generate the video. Essentially this would remove as much of the changes over time as possible from the face. Should make it more temporally consistent as the transforms will remove the back and forth movement issues.

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.

  • PaddlePaddle

    PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)

    Project mention: Baidu AI Researchers Introduce SE-MoE That Proposes Elastic MoE Training With 2D Prefetch And Fusion Communication Over Hierarchical Storage | reddit.com/r/artificial | 2022-05-29

    Continue reading | Check out the paper, and Github

  • CNTK

    Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

    Project mention: Worldwide building footprints derived from satellite imagery from Microsoft | reddit.com/r/gis | 2022-05-20
  • ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    Project mention: [D] Best way to package Pytorch models as a standalone application | reddit.com/r/MachineLearning | 2023-01-06

    They're using NCNN to package the model. Have a look. https://github.com/Tencent/NCNN

  • Dlib

    A toolkit for making real world machine learning and data analysis applications in C++

    Project mention: What are some C++ projects with high quality code that I can read through? | reddit.com/r/cpp | 2023-01-16

    I really like dlib's code https://github.com/davisking/dlib

  • turicreate

    Turi Create simplifies the development of custom machine learning models.

    Project mention: Mac Studio for Deep Learning | reddit.com/r/MacStudio | 2022-10-02

    It depends. What kind of ML will you be working with? Apple's neural engine doesn't have an SDK, but they do have https://github.com/apple/turicreate which talks to CoreML. I've been thinking of getting an Mac Studio Ultra and have been researching whether this would be a good investment considering the advances in hardware lately, as well as Apple's release schedule. Been following Tenstorrent for news about their PCIe Gen 4 cards, too. In any case my wallet is going to be hurting soon. Also, have you checked this out? https://machinelearning.apple.com/research/neural-engine-transformers

  • carla

    Open-source simulator for autonomous driving research.

    Project mention: Best Self Driving Cars Projects. | reddit.com/r/SelfDrivingCars | 2022-09-06

    It sounds like you're looking for something like the CARLA simulator.

  • onnxruntime

    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

    Project mention: Using AI to infer depth information from images in Godot 4 .NET 6 using the MiDaS monocular depth model | reddit.com/r/godot | 2022-12-01

    Unsure how useful this is, and the project itself needs a bit of a cleanup since I ported it to godot 4 last night. But at the very least, it provides an example of using the ONNX Runtime package in C# to transfer image data to and from a pre-trained model.

  • MNN

    MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

    Project mention: What’s New in TensorFlow 2.10? | news.ycombinator.com | 2022-09-06

    There are a ton of mobile deployment options that support PyTorch+TF models. It's hard to argue TFLite is the best.


  • TensorRT

    NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

    Project mention: Speeding up T5 | reddit.com/r/LanguageTechnology | 2023-01-22

    I've tried to speed it up with TensorRT and followed this example: https://github.com/NVIDIA/TensorRT/blob/main/demo/HuggingFace/notebooks/t5.ipynb - it does give considerable speedup for batch-size=1 but it does not work with bigger batch sizes, which is useless as I can simply increase the batch-size of HuggingFace model.

  • wav2letter

    Facebook AI Research's Automatic Speech Recognition Toolkit

    Project mention: How to convert Speech-to-Text with Python? | dev.to | 2022-07-06

    Flashlight is a fast, flexible machine learning library written entirely in C++ from the Facebook AI Research Speech team and the creators of Torch and Deep Speech. Flashlight's ASR application (formerly the wav2letter project) provides training and inference capabilities for end-to-end speech recognition systems. This engine is really performant but you will need to compile all the C++ libraries before using it with Python.

  • jetson-inference

    Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

    Project mention: help with project involving object detection and tracking with camera | reddit.com/r/JetsonNano | 2022-06-18
  • serving

    A flexible, high-performance serving system for machine learning models

    Project mention: Should I wait for the M2 Macbook Pro? | reddit.com/r/macbookpro | 2022-10-10

    We’re looking into that solution at the moment, the issue I’m referring to is related to this https://github.com/tensorflow/serving/issues/1948 we’ll know if the plug-in approach works for our uses soon but haven’t started looking into implementing it yet

  • tiny-cnn

    header only, dependency-free deep learning framework in C++14

    Project mention: Creating AI without python | reddit.com/r/artificial | 2022-05-07
  • mace

    MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

    Project mention: What’s New in TensorFlow 2.10? | news.ycombinator.com | 2022-09-06
  • flashlight

    A C++ standalone library for machine learning (by flashlight)

    Project mention: Meta AI Open Sources Flashlight: Fast and Flexible Machine Learning Toolkit in C++ | reddit.com/r/artificial | 2022-09-12

    Continue reading | Check out the paper and github link

  • MegEngine

    MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

    Project mention: How to speedup 31*31 conv 10 times | news.ycombinator.com | 2022-04-25
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-02-03.

C++ Deep Learning related posts


What are some of the best open-source Deep Learning projects in C++? This list will help you:

Project Stars
1 tensorflow 170,805
2 OpenCV 66,201
3 Pytorch 62,234
4 Caffe 33,096
5 openpose 25,830
6 DeepSpeech 20,988
7 mediapipe 20,311
8 PaddlePaddle 19,485
9 CNTK 17,301
10 ncnn 16,344
11 Dlib 11,690
12 turicreate 10,904
13 carla 8,750
14 onnxruntime 8,164
15 MNN 7,310
16 TensorRT 6,529
17 wav2letter 6,180
18 jetson-inference 6,085
19 serving 5,750
20 tiny-cnn 5,627
21 mace 4,730
22 flashlight 4,710
23 MegEngine 4,441
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives