[R] Stanford-Alpaca 7B model (an instruction tuned version of LLaMA) performs as well as text-davinci-003

• llama

  184 53,053 8.1 Python

  Inference code for Llama models

  

They did not. Some random person is asking Meta to change it.

• stanford_alpaca

  108 28,816 2.0 Python

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

Blog post: https://crfm.stanford.edu/2023/03/13/alpaca.html Demo: https://crfm.stanford.edu/alpaca/ Code: https://github.com/tatsu-lab/stanford_alpaca

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• trlx

  5 4,324 7.9 Python

  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

  

If you checkout the trlx repo they have some examples and they have an example of how they trained sft and ppo on the hh dataset. So it’s basically that but with llama. https://github.com/CarperAI/trlx/blob/main/examples/hh/sft_hh.py

• trl

  13 8,120 9.7 Python

  Train transformer language models with reinforcement learning.

  

Just the hh directly. From the results it seems like it might possibly be enough but I might also try instruction tuning then running the whole process from that base. I will also be running the reinforcement learning by using a Lora using this as an example https://github.com/lvwerra/trl/tree/main/examples/sentiment/scripts/gpt-neox-20b_peft

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

#1: The new streaming algorithm has been merged. It's a lot faster! | 6 comments #2: Text streaming will become 1000000x faster tomorrow #3: LLaMA tutorial (including 4-bit mode) | 10 comments

• alpaca-lora

  107 18,197 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

Found this: https://github.com/tloen/alpaca-lora

Suggest a related project