What's the current "Best" LLaMA LoRA? or moreover what would be a good benchmark to test these against. (HF links incl in post)

• point-alpaca

  9 408 4.2 Python
  

It's not a LoRA, but this is the best I've tried: https://github.com/pointnetwork/point-alpaca It requires a GPU.

• lora

  83 6,597 0.0 Jupyter Notebook

  Using Low-rank adaptation to quickly fine-tune diffusion models. (by cloneofsimo)

It's smaller in file size than a full set of weights because it's stored as two low-rank matrices that get multiplied together to generate the weight deltas. See the research paper for details.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project