How can I train my custom dataset on top of Vicuna?

• alpaca-lora

  107 18,238 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

• LLaMA-LoRA-Tuner

  6 425 7.9 Python

  UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• stanford_alpaca

  108 28,893 2.0 Python

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

If you have access to the data-center grade GPU, the quickest way to start would be to pick one of the efforts of fine-tuning, for example, stanford alpaca (https://github.com/tatsu-lab/stanford_alpaca/ ) or indeed, vicuna (https://github.com/lm-sys/FastChat ) and use your own data. The main issue for home users is that their VRAM is vastly insufficient for standard model tuning (original weights, updated weights, a copy of adam himself, and a copy for the AI overlord…)

• FastChat

  83 34,514 9.6 Python

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

If you have access to the data-center grade GPU, the quickest way to start would be to pick one of the efforts of fine-tuning, for example, stanford alpaca (https://github.com/tatsu-lab/stanford_alpaca/ ) or indeed, vicuna (https://github.com/lm-sys/FastChat ) and use your own data. The main issue for home users is that their VRAM is vastly insufficient for standard model tuning (original weights, updated weights, a copy of adam himself, and a copy for the AI overlord…)

• simple-llm-finetuner

  12 1,977 10.0 Jupyter Notebook

  Discontinued Simple UI for LLM Model Finetuning

• text-generation-webui

  876 36,827 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Sure! This is the link to Oobabooga https://github.com/oobabooga/text-generation-webui

Suggest a related project