Free open-source 30 billion parameters mini-ChatGPT LLM running on mainstream PC now available!

• alpaca.cpp

  94 9,878 9.4 C

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• GPTQ-for-LLaMa

  75 2,913 8.6 Python

  4 bits quantization of LLaMA using GPTQ

Using the GPTQ implementation, there are effectively no differences between the two. The benchmarks on the GitHub repo show the full details.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• alpaca-docker

  1 4 3.7 Dockerfile

  A dockerfile for installing alpaca

It's already easy to use with dalai, but I made a dockerfile to avoid installing the requirements and put it at https://github.com/machado2/alpaca-docker

• text-generation-webui

  876 35,862 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Use oobabooga's text generation webui.

Suggest a related project