Our great sponsors
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
I'd try to use libtorch with C++ and load a jit-exported model. You'll probably have to compile your own version of libtorch, so https://github.com/ljk53/pytorch-rpi might be a good place to start?
Source: https://github.com/pytorch/pytorch/releases/tag/v1.10.0
Here is a scriptable beam-search in fairseq.
I like to use the setup pytorch -> onnx -> tract Tract runs efficiently on ARM single board computers.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.