Fine-tuning Llama

• TencentPretrain

  1 975 7.8 Python

  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

  

• stanford_alpaca

  108 28,761 2.0 Python

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

Something else that might be worth keeping an eye on. https://github.com/tatsu-lab/stanford_alpaca

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

Code and weights are here for a single gpu to replicate alpaca: https://github.com/tloen/alpaca-lora

• text-generation-webui

  876 35,862 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Discussion on github: https://github.com/oobabooga/text-generation-webui/issues/332

Suggest a related project