Top 23 C++ Deep Learning Projects
-
TensorFlow Lite Python image classification demo
-
Is it possible for GitHub to mirror the releases in multiple different places(they likely do that, but I mean complete isolation where an outage like this doesn't break the downloads). Maybe like a proxy to object store, so it is a little more reliable(a setup such as this, should have less moving and custom parts).
So in a moment like this, you can convert https://github.com/opencv/opencv/archive/4.5.3.zip to https://archive.github.com/opencv/opencv/archive/4.5.3.zip. Maybe an implicit agreement of somewhat stale data by add the sub-domain "archive.". They'll try to maintain low sync times on a "best effort basis".)
-
-
One of my coworkers managed to get pytorch working with AMD but it took him a week to get everything working properly (which in itself was surprising given previous history). And that's with the current driver + library version stack -- who knows what it's going to be like in 6 months time, half the time to get this stuff working you're following some guy's side project on github that he could get bored with and stop supporting at any point.
-
Caffe de BAIR
-
openpose
OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
Project mention: Help finding an appropriate model for human pose estimation | reddit.com/r/computervision | 2021-09-29Openpose: This is supposedly realtime (I assume on a gpu, 24fps?) and they provide training code
-
DeepSpeech
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
Tried Kõnele but no dice. DeepSpeech looks promising but will it install/run on AOSP?
-
-
Scout APM
Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
-
Project mention: Mobile app for machine learning deployment? | reddit.com/r/learnmachinelearning | 2021-11-27
MediaPipe has some nice examples. These often wraps TFlite models on mobile.
-
ncnn
ncnn is a high-performance neural network inference framework optimized for the mobile platform
ncnn install ncnn
-
Project mention: Are 3 monitors worth it? Yes, absolutely yes. | reddit.com/r/battlestations | 2021-11-22
-
Project mention: Currently writing out a plan for an RL based path-planning project. (I'm doing it for my Smart Vehicles course in my Master's Degree) Don't have much domain knowledge atm but looking for some advice on how to approach the problem? | reddit.com/r/reinforcementlearning | 2021-10-02
Carla: https://github.com/carla-simulator/carla
-
MNN
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba
Project mention: Newbie having error code of cannot build selected target abi x86 no suitable splits configured | reddit.com/r/AndroidStudio | 2021-04-12I found a solution on GitHub check your app's build.gradle, defaultConfig section - you need to add x86 to your ndk abiFilters ndk.abiFilters 'armeabi-v7a','arm64-v8a', 'x86' GitHub Hope it will help. You have to find that file and edit it as given here
-
Project mention: Inference machine learning models in the browser with JavaScript and ONNX Runtime Web | dev.to | 2021-11-26
ONNX Runtime GitHub
-
-
Project mention: Running concurrent inference processes in Flask or should I use FastAPI? | reddit.com/r/flask | 2021-03-29
Don't roll this yourself. Look at Tensorflow Serving: https://github.com/tensorflow/serving.
-
jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
Project mention: Jetson Nano 2GB Issues During Training (Out Of Memory / Process Killed) & Other Questions! | reddit.com/r/JetsonNano | 2021-11-05I’m trying to do the tutorial, where they retrain the neural network to detect fruits (jetson-inference/pytorch-ssd.md at master · dusty-nv/jetson-inference · GitHub 1)
-
TensorRT
TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
Project mention: [P] Python library to optimize Hugging Face transformer for inference: < 0.5 ms latency / 2850 infer/sec | reddit.com/r/MachineLearning | 2021-11-23On the other side of the spectrum, there is Nvidia demos (here or there) showing us how to build manually a full Transformer graph (operator by operator) in TensorRT to get best performance from their hardware. It’s out of reach for many NLP practitioners and it’s time consuming to debug/maintain/adapt to a slightly different architecture (I tried). Plus, there is a secret: the very optimized model only works for specific sequence lengths and batch sizes. Truth is that, so far (and it will improve soon), it’s mainly for MLPerf benchmark (the one used to compare DL hardware), marketing content, and very specialized engineers.
-
Project mention: Mozilla Common Voice Adds 16 New Languages and 4,600 New Hours of Speech | news.ycombinator.com | 2021-08-05
I've had good results with https://github.com/flashlight/flashlight/blob/master/flashli.... Seems to work well with spoken english in a variety of accents. Biggest limitation is that the architecture they have pretrained models for doesn't really work well with clips longer than ~15 seconds, so you have to segment your input files.
-
Github Repository: https://github.com/mlpack/mlpack Developed By: Community, supported by Georgia Institute of technology Primary purpose: Multiple ML Models and Algorithms
-
DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
Project mention: [D] Efficiently loading videos in PyTorch without extracting frames | reddit.com/r/MachineLearning | 2021-10-26 -
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)
Tools for developing and deploying large language models: NVIDIA NeMo Megatron, for training models with trillions of parameters; the Megatron 530B customizable LLM that can be trained for new domains and languages; and NVIDIA Triton Inference Server™ with multi-GPU, multinode distributed inference functionality.
-
Project mention: OneFlow: Redesign the Distributed Deep Learning Framework from Scratch[P] | reddit.com/r/MachineLearning | 2021-10-29
Code for https://arxiv.org/abs/2110.15032 found: https://github.com/Oneflow-Inc/oneflow
-
Project mention: GraphScope: A One-Stop Large-Scale Graph Computing System | news.ycombinator.com | 2021-02-02
C++ Deep Learning related posts
- Mobile app for machine learning deployment?
- Inference machine learning models in the browser with JavaScript and ONNX Runtime Web
- Model/Tool to use on Jetson for efficient Quantization/Pruning
- Query regarding Multiple face recognization system
- Is there a viable AOSP speech-to-text app?
- suggestions for live speech recognition?
- Nvidia Ceo- Jensen on competition from Amd.
Index
What are some of the best open-source Deep Learning projects in C++? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | tensorflow | 160,825 |
| 2 | OpenCV | 58,114 |
| 3 | Pytorch | 52,265 |
| 4 | Caffe | 32,090 |
| 5 | openpose | 22,621 |
| 6 | DeepSpeech | 18,523 |
| 7 | CNTK | 17,122 |
| 8 | mediapipe | 14,817 |
| 9 | ncnn | 13,219 |
| 10 | Dlib | 10,726 |
| 11 | carla | 6,900 |
| 12 | MNN | 6,229 |
| 13 | onnxruntime | 5,768 |
| 14 | tiny-cnn | 5,459 |
| 15 | serving | 5,278 |
| 16 | jetson-inference | 5,105 |
| 17 | TensorRT | 4,548 |
| 18 | flashlight | 4,015 |
| 19 | mlpack | 3,847 |
| 20 | DALI | 3,585 |
| 21 | server | 2,872 |
| 22 | oneflow | 2,784 |
| 23 | euler | 2,694 |
Are you hiring? Post a new remote job listing for free.
