ML-examples
MNN
| ML-examples | MNN | |
|---|---|---|
| 2 | 3 | |
| 406 | 8,313 | |
| 2.2% | 0.9% | |
| 5.0 | 8.0 | |
| 9 months ago | 13 days ago | |
| C++ | C++ | |
| Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ML-examples
-
[D] Run Pytorch model inference on Microcontroller
CMSIS-NN. ARM centric. Examples. They also have an example for a pytorch to tflite converter via onnx
-
Machine Learning on ARM
Well there's something, https://github.com/ARM-software/ML-examples
MNN
-
[D][R] Deploying deep models on memory constrained devices
However, I am looking on this subject through the problem of training/finetuning deep models on the edge devices, being increasingly available thing to do. Looking at tflite, alibaba's MNN, mit-han-lab's tinyengine etc..
-
What’s New in TensorFlow 2.10?
There are a ton of mobile deployment options that support PyTorch+TF models. It's hard to argue TFLite is the best.
https://github.com/alibaba/MNN
-
Newbie having error code of cannot build selected target abi x86 no suitable splits configured
I found a solution on GitHub check your app's build.gradle, defaultConfig section - you need to add x86 to your ndk abiFilters ndk.abiFilters 'armeabi-v7a','arm64-v8a', 'x86' GitHub Hope it will help. You have to find that file and edit it as given here
What are some alternatives?
oneflow - OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
tensorflow - An Open Source Machine Learning Framework for Everyone
TNN - TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
onnx2c - Open Neural Network Exchange to C compiler.
ncnn - ncnn is a high-performance neural network inference framework optimized for the mobile platform
CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
tinyengine - [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory
serving - A flexible, high-performance serving system for machine learning models
OpenMLDB - OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.