EdgeML
tinyengine
EdgeML | tinyengine | |
---|---|---|
1 | 3 | |
1,541 | 742 | |
0.8% | 3.1% | |
0.0 | 5.6 | |
about 1 month ago | about 1 month ago | |
C++ | C | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
EdgeML
-
Great Quantization Libraries? [D]
There is compiler from microsoft called SEEDOT https://github.com/microsoft/EdgeML/tree/master/tools/SeeDot , very good for 8bit , not sure for 4bit , what is usecase you compile it down to 4 bit systems
tinyengine
-
[D] Run Pytorch model inference on Microcontroller
TinyEngine from MCUNet. Looks great, targeting ARM CM4.
-
[D][R] Deploying deep models on memory constrained devices
However, I am looking on this subject through the problem of training/finetuning deep models on the edge devices, being increasingly available thing to do. Looking at tflite, alibaba's MNN, mit-han-lab's tinyengine etc..
- TinyEngine: High-performance neural network library for Microcontrollers
What are some alternatives?
MetisFL - The first open Federated Learning framework implemented in C++ and Python.
prnf - A lightweight tiny printf alternative. With some reasonable limitations, extensions, and alternative behaviour suited to microcontrollers.
nebuly - The user analytics platform for LLMs
nnom - A higher-level Neural Network library for microcontrollers.
vit.cpp - Inference Vision Transformer (ViT) in plain C/C++ with ggml
ML-examples - Arm Machine Learning tutorials and examples
ai8x-synthesis - Quantization and Synthesis (Device Specific Code Generation) for ADI's MAX78000 and MAX78002 Edge AI Devices
SLID-on-Microcontrollers - Speech Classification using a Convolutional Neural Network running on a Microcontroller
TinyMaix - TinyMaix is a tiny inference library for microcontrollers (TinyML).
onnx2c - Open Neural Network Exchange to C compiler.
STM32-HAL-HD44780-16x2LCD - A simple library for STM32 microcontrollers to drive 16x2 LCD displays based on the HD44780 controller
deepC - vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers