vanilla-llama
chat-llama-discord-bot
vanilla-llama | chat-llama-discord-bot | |
---|---|---|
3 | 1 | |
179 | 115 | |
- | - | |
4.8 | 6.5 | |
12 months ago | 12 months ago | |
Python | Python | |
GNU General Public License v3.0 only | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vanilla-llama
-
How to extract vector embeddings from passages analyzed with LLaMA
I shouldn't have any trouble with the second step, but I'm not sure how to get started on the first one. I found a Python package for interfacing with LLaMA, but its examples focus on just generating text, and I'm not sure how I would actually get embedding vectors or anything beyond text generation. Ideally, I would like to not even just create embedding vectors but rather directly hook up some new layers to LLaMA for supervised learning.
- Has anyone used LLaMA with a TPU instead of GPU?
- [P] vanilla-llama an hackable plain-pytorch implementation of LLaMA that can be run on any system (if you have enough resources)
chat-llama-discord-bot
What are some alternatives?
LLaVA - [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
mPLUG-Owl - mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model
LLaMA_MPS - Run LLaMA inference on Apple Silicon GPUs.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Chinese-LLaMA-Alpaca - 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
signal-aichat - An AI chatbot for Signal powered by Google Bard, Bing Chat, ChatGPT, HuggingChat, and llama.cpp
xTuring - Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
fantasy_football_chat_bot - GroupMe Discord and Slack Chatbot for ESPN Fantasy Football
coral-pi-rest-server - Perform inferencing of tensorflow-lite models on an RPi with acceleration from Coral USB stick
yal-discord-bot - Yet Another LLaMA/ALPACA Discord Bot
booster - Booster - open platform for serving LLM models