Fine-tuning LLMs with LoRA: A Gentle Introduction

• stanford_alpaca

  108 28,761 2.0 Python

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

In this article, we're going to experiment with LoRA and fine-tune Llama Alpaca using commercial hardware.

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

Implement the code in Llama LoRA repo in a script we can run locally

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• GPT-4-LLM

  5 3,961 5.4 HTML

  Instruction Tuning with GPT-4

I'm using the Instruction Tuning with GPT-4 dataset, which is hosted on Huggingface.

Suggest a related project