GitHub - artidoro/qlora: QLORA: Efficient Finetuning of Quantized LLMs

• qlora

  80 9,388 7.4 Jupyter Notebook

  QLoRA: Efficient Finetuning of Quantized LLMs

can you send this to https://github.com/artidoro/qlora/issues? I'm not exactly the author.

• alpaca_lora_4bit

  41 528 8.6 Python

I wonder how it compares with the already existing 4-bit finetuning at https://github.com/johnsmith0031/alpaca_lora_4bit , I tried it and indeed it can finetune Llama-65B with only 2x3090 (although it takes a week) and results are apparently good.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• bitsandbytes

  61 5,389 9.4 Python

  Accessible large language models via k-bit quantization for PyTorch.

it's in the current main branch on git, https://github.com/TimDettmers/bitsandbytes/blob/main/CHANGELOG.md, transformers same, https://github.com/huggingface/transformers/pull/23479

• transformers

  175 125,021 10.0 Python

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

it's in the current main branch on git, https://github.com/TimDettmers/bitsandbytes/blob/main/CHANGELOG.md, transformers same, https://github.com/huggingface/transformers/pull/23479

Suggest a related project