[P] minLoRA: An Easy-to-Use PyTorch Library for Applying LoRA to PyTorch Models

1. minLoRA

   1 3 464 2.4 Jupyter Notebook

   minLoRA: a minimal PyTorch library that allows you to apply LoRA to any PyTorch model.

   

   Theirs requires you to rewrite the whole model and replace every layer you want to apply LoRA to to the LoRA counterpart, or use monky-patching. Mine utilizes PyTorch parametrizations to inject the LoRA logic to existing models. If your model has nn.Linear, you can call add_lora(model) to add LoRA to all the linear layers. And it's not limited to Linear, you can see how I extended it to Embedding, Conv2d in a couple lines of code. https://github.com/cccntu/minLoRA/blob/main/minlora/model.py

2. Sevalla

   sevalla.com featured

   Deploy and host your apps and databases, now with $50 credit! Sevalla is the PaaS you have been looking for! Advanced deployment pipelines, usage-based pricing, preview apps, templates, human support by developers, and much more!

   

3. peft

   2 27 19,421 9.6 Python

   🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

   

   Sorry, but why do we need another package? Can't you build on top of https://github.com/huggingface/peft ?

Suggest a related project