Top 23 C++ Deep Learning Projects
-
No surprises here: deep learning is the most popular subcategory, with hugging face transformers repo, YOLOv5, Tensorflow and Deepmind’s Alphafold all in the mix. Surprisingly, the only proper infrastructure-ey repos on the list are Meilisearch and Clickhouse, a tad bit surprising given all the hype data infrastructure receives in VC-world, but again, probably just a question of size of end-user populations + whether data scientists spend tons of time on Github vs. Web Developers…
-
Project mention: google.protobuf.message.DecodeError: Error parsing message with type 'tensorflow.GraphDef' | reddit.com/r/tensorflow | 2022-01-19
Tried to convert my model.pb file to .pbtxt using this script: https://github.com/opencv/opencv/wiki/TensorFlow-text-graphs
-
OPS
OPS - Build and Run Open Source Unikernels. Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.
-
If you look at the commit that you committed: https://github.com/pytorch/pytorch/commit/fdcb78df38f61e9c18b105e1fd56490e4f285064
-
Project mention: How do I install Caffe framework on Mac M1? | reddit.com/r/MLQuestions | 2022-01-04
-
openpose
OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
Have you considered using an already trained open source pose model? Something like openpose would work. Then you could have estimated "boxes" relative to the top of the torso and the head cut in half, where the bottom half flags it as a low guard for example. This approach would be more accurate and easier than making a whole new model for a specific necessity, though there is the problem that the dataset used for this may lack people in things like gloves or martial arts equipment.
-
DeepSpeech
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
Project mention: I have 10,000 hours of audio files I'd like transcribed. | reddit.com/r/software | 2022-01-18You might be able to get some success with Project DeepSpeech
-
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
Project mention: First try to replicate mediapipe codepen hand detection. | reddit.com/r/cpp | 2021-12-28
I have used mediapipie library to make this. https://github.com/google/mediapipe
-
ncnn
ncnn is a high-performance neural network inference framework optimized for the mobile platform
ncnn install ncnn
-
Project mention: [D] Is Rust stable/mature enough to be used for production ML? Is making Rust-based python wrappers a good choice for performance heavy uses and internal ML dependencies in 2021? | reddit.com/r/MachineLearning | 2021-12-30
Why not do it all in C++? Dlib has good support for ML. For instance, this is how one would do a simple MNIST example:
-
Project mention: What interesting things are people making using a game engine that's not actually a game? | reddit.com/r/gamedev | 2021-12-27
https://carla.org , autonomous driving stuff in unreal,
-
MNN
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba
Project mention: Newbie having error code of cannot build selected target abi x86 no suitable splits configured | reddit.com/r/AndroidStudio | 2021-04-12I found a solution on GitHub check your app's build.gradle, defaultConfig section - you need to add x86 to your ndk abiFilters ndk.abiFilters 'armeabi-v7a','arm64-v8a', 'x86' GitHub Hope it will help. You have to find that file and edit it as given here
-
txtai supports generating vectors with Hugging Face Transformers, PyTorch, ONNX and Word Vector models.
-
-
Project mention: Running concurrent inference processes in Flask or should I use FastAPI? | reddit.com/r/flask | 2021-03-29
Don't roll this yourself. Look at Tensorflow Serving: https://github.com/tensorflow/serving.
-
jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
Project mention: Jetson Nano 2GB Issues During Training (Out Of Memory / Process Killed) & Other Questions! | reddit.com/r/JetsonNano | 2021-11-05I’m trying to do the tutorial, where they retrain the neural network to detect fruits (jetson-inference/pytorch-ssd.md at master · dusty-nv/jetson-inference · GitHub 1)
-
TensorRT
TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
Project mention: [P] Python library to optimize Hugging Face transformer for inference: < 0.5 ms latency / 2850 infer/sec | reddit.com/r/MachineLearning | 2021-11-23On the other side of the spectrum, there is Nvidia demos (here or there) showing us how to build manually a full Transformer graph (operator by operator) in TensorRT to get best performance from their hardware. It’s out of reach for many NLP practitioners and it’s time consuming to debug/maintain/adapt to a slightly different architecture (I tried). Plus, there is a secret: the very optimized model only works for specific sequence lengths and batch sizes. Truth is that, so far (and it will improve soon), it’s mainly for MLPerf benchmark (the one used to compare DL hardware), marketing content, and very specialized engineers.
-
Flashlight bro, not flash. Read again
-
Project mention: Ensmallen: A C++ Library for Efficient Numerical Optimization | news.ycombinator.com | 2021-12-08
This toolkit was originally part of the mlpack machine learning library (https://github.com/mlpack/mlpack) before it was split out into a separate, standalone effort.
-
DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
Project mention: [D] Efficiently loading videos in PyTorch without extracting frames | reddit.com/r/MachineLearning | 2021-10-26 -
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)
Project mention: [D] patterns for scaling video inference service? | reddit.com/r/MachineLearning | 2021-12-22If you are working at an infrastructure level I would use ECS and utilize the NVIDIA Triton Inference Server. It can handle the multimodel paradigm through their ensemble method (bit of a misnomer since its really just a DAG of data flow through your models though you can add an ensembling method at the end of desired). Also provides a nice HTTP or GRPC interface. With ECS you can also use Application Load Balancer to further scale but how you set that up will also heavily depend on if you are using stateful models or not.
-
Project mention: Optimization of CUDA Elementwise Template Library: Practical, Efficient, and Extensible | reddit.com/r/CUDA | 2022-01-20
Elementwise operation refers to applying a function transformation to every element of a tensor. In deep learning, many operators can be regraded as elementwise operators, such as common activation functions (like ReLU and GELU) and ScalarMultiply (multiplying each element of a tensor by a scalar). For this elementwise operation, OneFlow(https://github.com/Oneflow-Inc/oneflow/) abstracts a CUDA template. this article will introduce the design thoughts and optimization techniques of CUDA template.
-
Project mention: How the network architecture in EAST text detector translates to keras? | reddit.com/r/MLQuestions | 2021-12-03
I'm not sure whether I'm among a few or many who struggle translating academic papers to code. I tried looking for EAST reliable implementation, and so far I only found this (TF 1.x), this (pytorch), this (pytorch), ... and a few others. The problem is that I cannot tell the differences between each and the paper's implementation. Here's the network architecture below, can someone explain how I should read and interpret / convert what is understood from the figure to a keras model. The parts I find tricky:
C++ Deep Learning related posts
- Optimization of CUDA Elementwise Template Library: Practical, Efficient, and Extensible
- google.protobuf.message.DecodeError: Error parsing message with type 'tensorflow.GraphDef'
- I have 10,000 hours of audio files I'd like transcribed.
- Pytorch Distributed Parallel Computing or Hpc Research
- [D] Is there an open-source implementation of the Retrieval-Enhanced Transformer (RETRO)?
- [D] Does PyTorch credit contributors?
- Audio to text transcription
Index
What are some of the best open-source Deep Learning projects in C++? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | tensorflow | 162,156 |
| 2 | OpenCV | 59,285 |
| 3 | Pytorch | 53,342 |
| 4 | Caffe | 32,205 |
| 5 | openpose | 23,137 |
| 6 | DeepSpeech | 18,854 |
| 7 | CNTK | 17,116 |
| 8 | mediapipe | 15,775 |
| 9 | ncnn | 13,576 |
| 10 | Dlib | 10,877 |
| 11 | carla | 7,131 |
| 12 | MNN | 6,357 |
| 13 | onnxruntime | 6,097 |
| 14 | tiny-cnn | 5,487 |
| 15 | serving | 5,350 |
| 16 | jetson-inference | 5,268 |
| 17 | TensorRT | 4,761 |
| 18 | flashlight | 4,051 |
| 19 | mlpack | 3,879 |
| 20 | DALI | 3,674 |
| 21 | server | 3,123 |
| 22 | oneflow | 2,967 |
| 23 | EAST | 2,803 |
Are you hiring? Post a new remote job listing for free.
