C++ Deep Learning

Open-source C++ projects categorized as Deep Learning | Edit details

Top 23 C++ Deep Learning Projects

  • GitHub repo tensorflow

    An Open Source Machine Learning Framework for Everyone

    Project mention: Running a basic TensorFlow Lite model on e-RT3 Plus | dev.to | 2021-11-15

    TensorFlow Lite Python image classification demo

  • GitHub repo OpenCV

    Open Source Computer Vision Library

    Project mention: GitHub Down again 11/27/2021 | news.ycombinator.com | 2021-11-27

    Is it possible for GitHub to mirror the releases in multiple different places(they likely do that, but I mean complete isolation where an outage like this doesn't break the downloads). Maybe like a proxy to object store, so it is a little more reliable(a setup such as this, should have less moving and custom parts).

    So in a moment like this, you can convert https://github.com/opencv/opencv/archive/4.5.3.zip to https://archive.github.com/opencv/opencv/archive/4.5.3.zip. Maybe an implicit agreement of somewhat stale data by add the sub-domain "archive.". They'll try to maintain low sync times on a "best effort basis".)

  • Nanos

    Run Linux Software Faster and Safer than Linux with Unikernels.

  • GitHub repo Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

    Project mention: Nvidia Ceo- Jensen on competition from Amd. | reddit.com/r/Amd | 2021-11-23

    One of my coworkers managed to get pytorch working with AMD but it took him a week to get everything working properly (which in itself was surprising given previous history). And that's with the current driver + library version stack -- who knows what it's going to be like in 6 months time, half the time to get this stuff working you're following some guy's side project on github that he could get bored with and stop supporting at any point.

  • GitHub repo Caffe

    Caffe: a fast open framework for deep learning.

    Project mention: Una corta intro a las Redes Neuronales Artificiales | dev.to | 2021-09-22

    Caffe de BAIR

  • GitHub repo openpose

    OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

    Project mention: Help finding an appropriate model for human pose estimation | reddit.com/r/computervision | 2021-09-29

    Openpose: This is supposedly realtime (I assume on a gpu, 24fps?) and they provide training code

  • GitHub repo DeepSpeech

    DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

    Project mention: Is there a viable AOSP speech-to-text app? | reddit.com/r/fossdroid | 2021-11-24

    Tried Kõnele but no dice. DeepSpeech looks promising but will it install/run on AOSP?

  • GitHub repo CNTK

    Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit (by microsoft)

  • Scout APM

    Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

    Project mention: Mobile app for machine learning deployment? | reddit.com/r/learnmachinelearning | 2021-11-27

    MediaPipe has some nice examples. These often wraps TFlite models on mobile.

  • GitHub repo ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    Project mention: ncnn convert | dev.to | 2021-09-29

    ncnn install ncnn

  • GitHub repo Dlib

    A toolkit for making real world machine learning and data analysis applications in C++

    Project mention: Are 3 monitors worth it? Yes, absolutely yes. | reddit.com/r/battlestations | 2021-11-22
  • GitHub repo carla

    Open-source simulator for autonomous driving research.

    Project mention: Currently writing out a plan for an RL based path-planning project. (I'm doing it for my Smart Vehicles course in my Master's Degree) Don't have much domain knowledge atm but looking for some advice on how to approach the problem? | reddit.com/r/reinforcementlearning | 2021-10-02

    Carla: https://github.com/carla-simulator/carla

  • GitHub repo MNN

    MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

    Project mention: Newbie having error code of cannot build selected target abi x86 no suitable splits configured | reddit.com/r/AndroidStudio | 2021-04-12

    I found a solution on GitHub check your app's build.gradle, defaultConfig section - you need to add x86 to your ndk abiFilters ndk.abiFilters 'armeabi-v7a','arm64-v8a', 'x86' GitHub Hope it will help. You have to find that file and edit it as given here

  • GitHub repo onnxruntime

    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

    Project mention: Inference machine learning models in the browser with JavaScript and ONNX Runtime Web | dev.to | 2021-11-26

    ONNX Runtime GitHub

  • GitHub repo tiny-cnn

    header only, dependency-free deep learning framework in C++14

  • GitHub repo serving

    A flexible, high-performance serving system for machine learning models

    Project mention: Running concurrent inference processes in Flask or should I use FastAPI? | reddit.com/r/flask | 2021-03-29

    Don't roll this yourself. Look at Tensorflow Serving: https://github.com/tensorflow/serving.

  • GitHub repo jetson-inference

    Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

    Project mention: Jetson Nano 2GB Issues During Training (Out Of Memory / Process Killed) & Other Questions! | reddit.com/r/JetsonNano | 2021-11-05

    I’m trying to do the tutorial, where they retrain the neural network to detect fruits (jetson-inference/pytorch-ssd.md at master · dusty-nv/jetson-inference · GitHub 1)

  • GitHub repo TensorRT

    TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

    Project mention: [P] Python library to optimize Hugging Face transformer for inference: < 0.5 ms latency / 2850 infer/sec | reddit.com/r/MachineLearning | 2021-11-23

    On the other side of the spectrum, there is Nvidia demos (here or there) showing us how to build manually a full Transformer graph (operator by operator) in TensorRT to get best performance from their hardware. It’s out of reach for many NLP practitioners and it’s time consuming to debug/maintain/adapt to a slightly different architecture (I tried). Plus, there is a secret: the very optimized model only works for specific sequence lengths and batch sizes. Truth is that, so far (and it will improve soon), it’s mainly for MLPerf benchmark (the one used to compare DL hardware), marketing content, and very specialized engineers.

  • GitHub repo flashlight

    A C++ standalone library for machine learning (by flashlight)

    Project mention: Mozilla Common Voice Adds 16 New Languages and 4,600 New Hours of Speech | news.ycombinator.com | 2021-08-05

    I've had good results with https://github.com/flashlight/flashlight/blob/master/flashli.... Seems to work well with spoken english in a variety of accents. Biggest limitation is that the architecture they have pretrained models for doesn't really work well with clips longer than ~15 seconds, so you have to segment your input files.

  • GitHub repo mlpack

    mlpack: a scalable C++ machine learning library --

    Project mention: Top 10 Python Libraries for Machine Learning | dev.to | 2021-09-09

    Github Repository: https://github.com/mlpack/mlpack Developed By: Community, supported by Georgia Institute of technology Primary purpose: Multiple ML Models and Algorithms

  • GitHub repo DALI

    A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

    Project mention: [D] Efficiently loading videos in PyTorch without extracting frames | reddit.com/r/MachineLearning | 2021-10-26
  • GitHub repo server

    The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)

    Project mention: Nvidia Fiscal Q3 2022 Financial Result | reddit.com/r/nvidia | 2021-11-17

    Tools for developing and deploying large language models: NVIDIA NeMo Megatron, for training models with trillions of parameters; the Megatron 530B customizable LLM that can be trained for new domains and languages; and NVIDIA Triton Inference Server™ with multi-GPU, multinode distributed inference functionality.

  • GitHub repo oneflow

    OneFlow is a performance-centered and open-source deep learning framework.

    Project mention: OneFlow: Redesign the Distributed Deep Learning Framework from Scratch[P] | reddit.com/r/MachineLearning | 2021-10-29

    Code for https://arxiv.org/abs/2110.15032 found: https://github.com/Oneflow-Inc/oneflow

  • GitHub repo euler

    A distributed graph deep learning framework. (by alibaba)

    Project mention: GraphScope: A One-Stop Large-Scale Graph Computing System | news.ycombinator.com | 2021-02-02


NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-11-27.

C++ Deep Learning related posts


What are some of the best open-source Deep Learning projects in C++? This list will help you:

Project Stars
1 tensorflow 160,825
2 OpenCV 58,114
3 Pytorch 52,265
4 Caffe 32,090
5 openpose 22,621
6 DeepSpeech 18,523
7 CNTK 17,122
8 mediapipe 14,817
9 ncnn 13,219
10 Dlib 10,726
11 carla 6,900
12 MNN 6,229
13 onnxruntime 5,768
14 tiny-cnn 5,459
15 serving 5,278
16 jetson-inference 5,105
17 TensorRT 4,548
18 flashlight 4,015
19 mlpack 3,847
20 DALI 3,585
21 server 2,872
22 oneflow 2,784
23 euler 2,694
Find remote jobs at our new job board 99remotejobs.com. There are 34 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives