Running oobabooga with Alpaca on Apple Silicon (M1/M2)

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

I struggle to find a working install of oobabooga and Alpaca model. Im running on a Macbook Pro M2 24GB.

• alpaca-electron

  8 1,260 5.9 JavaScript

  The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• dalai

  59 13,044 6.5 CSS

  The simplest way to run LLaMA on your local machine

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

Use llama.cpp

Suggest a related project