Would I be able to run ggml models such as whisper.cpp or llama.cpp on a raspberry pi with a coral ai USB Accelerator?

• whisper.cpp

  187 31,174 9.8 C

  Port of OpenAI's Whisper model in C/C++

• coral-pi-rest-server

  44 66 0.0 Jupyter Notebook

  Perform inferencing of tensorflow-lite models on an RPi with acceleration from Coral USB stick

However, a pi doesn't have the strength to run something like Llama.cpp, of course, so I've been considering using something like the Coral USB Accelerator (https://coral.ai/products/accelerator). As I've been learning more about it, it seems to be very geared towards TensorFlow Lite models. But whisper.cpp and Llama.cpp use ggml models.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project