yal-discord-bot
GPTQ-for-LLaMa
| yal-discord-bot | GPTQ-for-LLaMa | |
|---|---|---|
| 5 | 1 | |
| 72 | - | |
| - | - | |
| 6.5 | - | |
| about 1 year ago | - | |
| Python | ||
| GNU General Public License v3.0 or later | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
yal-discord-bot
- I wrote a Discord bot to host your own ChatGPT-style chatbot with ALPACA finetuned LLaMA weights on consumer GPUs. 13b fits in a 3080, 30b fits in a 3090. No censorship, ask anything you want!
- [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM
- Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM (r/MachineLearning)
GPTQ-for-LLaMa
What are some alternatives?
llama.cpp - LLM inference in C/C++
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
signal-aichat - An AI chatbot for Signal powered by Google Bard, Bing Chat, ChatGPT, HuggingChat, and llama.cpp
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
pifs - πfs - the data-free filesystem!
alpaca-lora - Instruct-tune LLaMA on consumer hardware
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
chat-llama-discord-bot - A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.
PokerGPT - PokerGPT Is a Poker Discord Bot that allows you to play Texas Hold'em poker with ChatGPT-4.