[D] LoRA vs P-Tuning for LLMS?

• lora

  83 6,616 0.0 Jupyter Notebook

  Using Low-rank adaptation to quickly fine-tune diffusion models. (by cloneofsimo)

Lora: https://arxiv.org/abs/2106.09685

• LoRA

  34 9,113 4.7 Python

  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  

Found relevant code at https://github.com/microsoft/LoRA + all code implementations here

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• peft

  26 13,877 9.7 Python

  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  

Also look at peft library from huggingface https://github.com/huggingface/peft

Suggest a related project