[D] Run Pytorch model inference on Microcontroller

• tinyengine

  3 747 5.6 C

  [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory (by mit-han-lab)

  

TinyEngine from MCUNet. Looks great, targeting ARM CM4.

• CMSIS-NN

  1 154 8.0 C

  CMSIS-NN Library

  

CMSIS-NN. ARM centric. Examples. They also have an example for a pytorch to tflite converter via onnx

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ML-examples

  2 406 5.0 C++

  Arm Machine Learning tutorials and examples

  

CMSIS-NN. ARM centric. Examples. They also have an example for a pytorch to tflite converter via onnx

• TinyMaix

  10 831 4.2 C

  TinyMaix is a tiny inference library for microcontrollers (TinyML).

  

TinyMaix. Very minimalistic, can also be used on RISC-V

• nnom

  1 806 7.2 C

  A higher-level Neural Network library for microcontrollers.

nnom

• ai8x-synthesis

  1 51 7.0 Python

  Quantization and Synthesis (Device Specific Code Generation) for ADI's MAX78000 and MAX78002 Edge AI Devices

  

MAX7800X Toolchain and Documentation (proprietary) This is a proprieteray toolchain to deploy models to the MAX78000 edge NN devices.

• MaximAI_Documentation

  1 88 5.0

  START HERE: Documentation for ADI's MAX78000 and MAX78002 Edge AI devices

  

MAX7800X Toolchain and Documentation (proprietary) This is a proprieteray toolchain to deploy models to the MAX78000 edge NN devices.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• deepC

  2 526 0.0 C++

  vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

  

DeepC. Open source version of DeepSea. Very little activity, looks abandoned

• onnx2c

  1 173 6.6 C

  Open Neural Network Exchange to C compiler.

onnx2c - onnx to c sourcecode converter. Looks interesting, but also not very active.

• cONNXr

  2 177 0.0 C

  Pure C ONNX runtime with zero dependancies for embedded devices

cONNXr - framework with C99 inference engine. Also interesting and not very active.

Suggest a related project