SaaSHub helps you find the best software and product alternatives Learn more →
Top 16 C++ neural-network Projects
-
DeepSpeech
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
armnn
Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
-
bergamot-translator
Cross platform C++ library focusing on optimized machine translation on the consumer-grade device.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
keras2cpp
it's a small library for running trained Keras 2 models from a native C++ code. (by gosha20777)
-
htm.core
Actively developed Hierarchical Temporal Memory (HTM) community fork (continuation) of NuPIC. Implementation for C++ and Python
-
tinymind
Tinymind is a Neural Network and Machine Learning project intended to provide a C++ template library for neural nets and machine learning algorithms within embedded systems.
-
iNeural
A library for creating Artificial Neural Networks, for use in Machine Learning and Deep Learning algorithms.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: ESpeak-ng: speech synthesizer with more than one hundred languages and accents | news.ycombinator.com | 2024-05-01As I understand it DeepSpeech is no longer actively maintained by Mozilla: https://github.com/mozilla/DeepSpeech/issues/3693
For Text To Speech, I've found Piper TTS useful (for situations where "quality"=="realistic"/"natual"): https://github.com/rhasspy/piper
For Speech to Text (which AIUI DeepSpeech provided), I've had some success with Vosk: https://github.com/alphacep/vosk-api
ONNX Runtime: ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
Project mention: LeCun: Qualcomm working with Meta to run Llama-2 on mobile devices | news.ycombinator.com | 2023-07-23Like ARM? https://github.com/ARM-software/armnn
Optimization for this workload has arguably been in-progress for decades. Modern AVX instructions can be found in laptops that are a decade old now, and most big inferencing projects are built around SIMD or GPU shaders. Unless your computer ships with onboard Nvidia hardware, there's usually not much difference in inferencing performance.
Project mention: Fast and secure translation on your local machine with a GUI | news.ycombinator.com | 2024-04-13Interestingly, I think this is actually related to the offline translation features built into Firefox. Both are products of "Project Bergamot", but the Mozilla-maintained version was later merged into the Firefox application:
https://browser.mt/
https://blog.mozilla.org/en/mozilla/local-translation-add-on...
https://hacks.mozilla.org/2022/06/training-efficient-neural-...
https://github.com/mozilla/firefox-translations
https://firefox-source-docs.mozilla.org/toolkit/components/t...
Extra webpage with screenshot and links, impossible to search for normally:
https://translatelocally.com/downloads/
Does one thing and does it well.
Oh— For downloading models, it's much easier to pipe/`xargs` `translateLocally --available-models` into `translateLocally -d` than go through the GUI.
---
Other self-hostable translation tools:
https://www.apertium.org/index.eng.html
- Traditional rule-based translation. Seems to work pretty well, but no good desktop frontend.
https://www.argosopentech.com/
- Works, but crashy desktop app.
https://libretranslate.com/
- API wrapping Argos Translate.
https://lingva.thedaviddelta.com/
- Google Translate scraper/privacy frontend.
https://euroglot.com/
- Proprietary, subscription trialware.
Project mention: Is there anything like Embedded Artificial Intelligence & Machine Learning? Can anyone tell me more about it? | /r/embedded | 2023-12-07Here's a resource-efficient Neural-Network library that I made1 specifically for MCUs, which I think you will find pretty interesting. Here's a simple xor-circuit NN example and here's a more advanced NN that predicts handwritten digits2 on an arduino UNO. Those combined with this research, I believe that will answer many of your questions and get you started.
Project mention: Is there anything like Embedded Artificial Intelligence & Machine Learning? Can anyone tell me more about it? | /r/embedded | 2023-12-07Take a look at TinyMind: https://github.com/danmcleran/tinymind
You can find the code here: https://github.com/CarloWood/machine-learning/blob/master/src/intersection_points.h
C++ neural-networks related posts
-
Oracle-samples/sd4j: Stable Diffusion pipeline in Java using ONNX Runtime
-
Ask HN: Speech to text models, are they usable yet?
-
Useful Transformers
-
ONNX runtime: Cross-platform accelerated machine learning
-
Onnx Runtime: “Cross-Platform Accelerated Machine Learning”
-
Can someone explain how keras code gets into the Tensorflow package?
-
Speech-to-Text in Real Time
-
A note from our sponsor - SaaSHub
www.saashub.com | 10 May 2024
Index
What are some of the best open-source neural-network projects in C++? This list will help you:
Project | Stars | |
---|---|---|
1 | DeepSpeech | 24,380 |
2 | onnxruntime | 12,804 |
3 | armnn | 1,120 |
4 | cppflow | 762 |
5 | useful-transformers | 310 |
6 | bergamot-translator | 301 |
7 | Open-L2O | 251 |
8 | keras2cpp | 183 |
9 | htm.core | 144 |
10 | Proteus | 140 |
11 | NeuralNetworks | 62 |
12 | PrincePedal | 30 |
13 | tinymind | 7 |
14 | machine-learning | 7 |
15 | iNeural | 5 |
16 | chess-deep-rl-cpp | 2 |
Sponsored