How to merge the two weights into a single weight?

• DetGPT

  4 719 7.0 Jupyter Notebook
  

Hey guys, I hope you are all doing well. I'm wondering how can I merge the two llama weights in this HF page (https://huggingface.co/TheBloke/llama-13b/tree/main) into a single llama weight that I could use? My end goal is to be able to use this model: https://github.com/OptimalScale/DetGPT. It needs to be able to merge the robin lora weights with the llama weights, but I'm not sure how to do that. Please help me. Thanks in advance!

• peft

  26 13,877 9.7 Python

  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  

To obtain the original llama model, one may refer to this doc. To merge a lora model with a base model, one may refer to PEFT or use the merge script provided by LMFlow.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project