Colab for finetuning llama models in 4-bit?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA
Deep Learning fine-tuning gpt-2 gpt-j llama

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • xTuring

    Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

    • I can't speak for QLORA, as I haven't had a chance to get an implementation working, but I've had success with StochasticAI's Xturing. It's by far the most streamlined method of finetuning I've come across, and they offer int8 and int4 fintuning (but only for llama-7B).

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts!

    1 project | /r/machinelearningnews | 7 Sep 2023

  • LLaMA 2 fine-tuning made easier and faster

    1 project | /r/Python | 25 Aug 2023

  • RAG vs. Fine-Tuning

    1 project | /r/LangChain | 22 Aug 2023

  • Build, customize and control your own personal LLMs via xTuring OSS

    1 project | /r/coolgithubprojects | 12 Aug 2023

  • Finetuning LLaMA 2 (the base models) ?

    1 project | /r/LocalLLaMA | 21 Jul 2023