PyTorch at the Edge: Deploy 964 TIMM Models on Android with TorchScript

• timm-flutter-pytorch-lite-blogpost

  7 36 2.4 Jupyter Notebook

  PyTorch at the Edge: Deploying Over 964 TIMM Models on Android with TorchScript and Flutter.

• EfficientConformer

  2 200 0.0 Python

  [ASRU 2021] Efficient Conformer: Progressive Downsampling and Grouped Attention for Automatic Speech Recognition

So I tried converting an ASR model[0] to ONNX about a year or two back. It was really painful. The pain could largely be ascribed to:

(1) code that is very dynamic, making it hard for Pytorch to convert the modules to TorchScript (which it does before converting them to ONNX)

(2) ops that were simply not available in ONNX. Especially, torch.fft, also some others.

[0] https://github.com/burchim/EfficientConformer

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project