I would like to try my hand at finetuning some models. What is the best way to start? I have some questions that I'd appreciate your help on.

• qlora-fine-tune

  6 163 3.8 Python

For all in one out of box scripts, have a look at https://github.com/mzbac/qlora-fine-tune

• axolotl

  29 5,811 9.8 Python

  Go ahead and axolotl questions

  

For finetunings, I would recommend the https://github.com/OpenAccess-AI-Collective/axolotl library. It is friendly for new users since there are pre-existing example configs to adapt for different base models and datasets. Also, the maintainers are pretty quick to add new techniques. As an example, they incorporated finetuning with QLoRA landmark tokens from u/NeverEndingToast over the weekend.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• xTuring

  31 2,523 8.4 Python

  Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

  

We are a group of researchers out of Harvard working on open-source library called xTuring, focused on fine-tuning LLMs: https://github.com/stochasticai/xturing.

Suggest a related project