A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.
Why do you think that https://github.com/Lightning-AI/lit-gpt is a good alternative to QLoRA-LLM