[D] Run Pytorch model inference on Microcontroller

• tinyengine

  3 734 5.6 C

  [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory (by mit-han-lab)

  

TinyEngine from MCUNet. Looks great, targeting ARM CM4.

• CMSIS-NN

  1 146 7.7 C

  CMSIS-NN Library

  

CMSIS-NN. ARM centric. Examples. They also have an example for a pytorch to tflite converter via onnx

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ML-examples

  2 405 5.0 C++

  Arm Machine Learning tutorials and examples

  

CMSIS-NN. ARM centric. Examples. They also have an example for a pytorch to tflite converter via onnx

• TinyMaix

  10 825 1.5 C

  TinyMaix is a tiny inference library for microcontrollers (TinyML).

  

TinyMaix. Very minimalistic, can also be used on RISC-V

• nnom

  1 799 3.8 C

  A higher-level Neural Network library for microcontrollers.

nnom

• ai8x-synthesis

  1 50 7.1 Python

  Quantization and Synthesis (Device Specific Code Generation) for ADI's MAX78000 and MAX78002 Edge AI Devices

  

MAX7800X Toolchain and Documentation (proprietary) This is a proprieteray toolchain to deploy models to the MAX78000 edge NN devices.

• MaximAI_Documentation

  1 87 4.9

  START HERE: Documentation for ADI's MAX78000 and MAX78002 Edge AI devices

  

MAX7800X Toolchain and Documentation (proprietary) This is a proprieteray toolchain to deploy models to the MAX78000 edge NN devices.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• deepC

  2 526 0.0 C++

  vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

  

DeepC. Open source version of DeepSea. Very little activity, looks abandoned

• onnx2c

  1 156 6.7 C

  Open Neural Network Exchange to C compiler.

onnx2c - onnx to c sourcecode converter. Looks interesting, but also not very active.

• cONNXr

  2 174 0.0 C

  Pure C ONNX runtime with zero dependancies for embedded devices

cONNXr - framework with C99 inference engine. Also interesting and not very active.

Suggest a related project