self-instruct
LongForm
self-instruct | LongForm | |
---|---|---|
3 | 1 | |
3,666 | 198 | |
- | - | |
2.3 | 4.2 | |
about 1 year ago | 3 months ago | |
Python | ||
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
self-instruct
-
The next generation of AI for developers and Google Workspace
When they say Augment your dataset with synthetic data on https://developers.googleblog.com/2023/03/announcing-palm-ap... do they mean something like this https://github.com/yizhongw/self-instruct ?
-
Alpaca- An Instruct Tuned Llama 7B. Responses on par with txt-DaVinci-3. Demo up
It says
> We train the Alpaca model on 52K instruction-following demonstrations generated in the style of self-instruct using text-davinci-003
Which leads to self-instruct https://github.com/yizhongw/self-instruct
From a glimpse they used a LM to classify instructions & train the model which IMHO very similar to RLHF
- Alpaca: A Strong Open-Source Instruction-Following Model
LongForm
What are some alternatives?
ChatGLM-6B - ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
awesome-instruction-dataset - A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
CodeCapypara - [Moved to: https://github.com/FSoft-AI4Code/CodeCapybara]
stanford_alpaca - Code and documentation to train Stanford's Alpaca models, and generate the data.
llama.cpp - LLM inference in C/C++
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
replika-research - Replika.ai Research Papers, Posters, Slides & Datasets
llama - Inference code for LLaMA models
llama - Inference code for Llama models
Open-Assistant - OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.