With a single 3090, which model is finetune-able and decent reasoning ability

• alpaca_lora_4bit

  41 528 8.6 Python

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

Well, I've not gone through the whole process till the end yet, but using instructions from https://github.com/tloen/alpaca-lora I was able just now to start a fine-tuning process on a LLaMA 13B model, it says it will take 15 hours.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• GPTQ-for-LLaMa

  3 12 8.0 Python

  4 bits quantization of LLaMa using GPTQ (by sterlind)

Suggest a related project