LLM-As-Chatbot
alpaca-7b-truss
| LLM-As-Chatbot | alpaca-7b-truss | |
|---|---|---|
| 3 | 2 | |
| 3,242 | 317 | |
| - | - | |
| 9.0 | 6.0 | |
| 6 months ago | 11 months ago | |
| Python | Python | |
| Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LLM-As-Chatbot
-
OpenAI's GPT-4 Red Teamer Nathan Labenz: the GPT-4 base model recommends assassinating humans, naming specific targets
The first one is from https://github.com/deep-diver/Alpaca-LoRA-Serve
-
Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
this is useless because it doesn't handle context:
Q: Name five genres of music.
A: Jazz, country, hip-hop, blues, classical.
Q: Name a famous artist from the third genre.
A: Salvador Dalí.
Whereas this one actually supports context: https://github.com/deep-diver/Alpaca-LoRA-Serve
- Show HN: Finetune LLaMA-7B on commodity GPUs using your own text
alpaca-7b-truss
-
[Project] ChatLLaMA - A ChatGPT style chatbot for Facebook's LLaMA
If you want deploy your own instance is the model powering the chatbot and build something similar we've open sourced the Truss here: https://github.com/basetenlabs/alpaca-7b-truss
-
Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
ChatLLaMA is an experimental chatbot interface for interacting with variants of Facebook's LLaMA. Currently, we support the 7 billion parameter variant that was fine-tuned on the Alpaca dataset. This early versions isn't as conversational as we'd like, but over the next week or so, we're planning on adding support for the 30 billion parameter variant, another variant fine-tuned on LAION's OpenAssistant dataset and more as we explore what this model is capable of.
If you want deploy your own instance is the model powering the chatbot and build something similar we've open sourced the Truss here: https://github.com/basetenlabs/alpaca-7b-truss
We'd love to hear any feedback you have. You can reach me on Twitter @aaronrelph or Abu (the engineer behind this) @aqaderb.
Disclaimer: We both work at Baseten. This was a weekend project. Not trying to shill anything; just want to build and share cool stuff.
What are some alternatives?
alpaca-lora - Instruct-tune LLaMA on consumer hardware
hh-rlhf - Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
simple-llm-finetuner - Simple UI for LLM Model Finetuning
chatllama - ChatLLaMA 📢 Open source implementation for LLaMA-based ChatGPT runnable in a single GPU. 15x faster training process than ChatGPT
peft - 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
stanford_alpaca - Code and documentation to train Stanford's Alpaca models, and generate the data.
nebuly - The user analytics platform for LLMs
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.