How to fine tune Llama?

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

If you mean a full fine tune, I don't know. If you mean training a LoRA, I would start with this guide: https://github.com/oobabooga/text-generation-webui/blob/main/docs/Training-LoRAs.md

• qlora

  80 9,388 7.4 Jupyter Notebook

  QLoRA: Efficient Finetuning of Quantized LLMs

You can also take a look at the QLoRA code: https://github.com/artidoro/qlora

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project