[Research] Alpaca 7B language model running on my Pixel 7

• alpaca.cpp

  4 253 6.2 C

  Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac) (by rupeshs)

• llama.cpp

  791 59,810 10.0 C++

  LLM inference in C/C++

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• GPTQ-for-LLaMa

  75 2,936 8.6 Python

  4 bits quantization of LLaMA using GPTQ

• ml-ane-transformers

  22 2,461 0.0 Python

  Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

  

Please, review this link and associated research paper: https://github.com/apple/ml-ane-transformers

Suggest a related project