Any guide/intro to fine-tuning anywhere?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA
chatgpt Deep Learning instruction-following language-model pretrained-models

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • alpaca_lora_4bit

    • https://github.com/johnsmith0031/alpaca_lora_4bit is still the SOTA - Faster than qlora, trains on a GPTQ base.

  • LMFlow

    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

    • You might want to have a look at LMFlow.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • axolotl

    Go ahead and axolotl questions

    • I have seen several folks using https://github.com/OpenAccess-AI-Collective/axolotl but no personal experience, please report back!

  • qlora

    QLoRA: Efficient Finetuning of Quantized LLMs

    • QLoRA https://github.com/artidoro/qlora

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts