privateGPT
DISCONTINUED
SillyTavern
Our great sponsors
privateGPT | SillyTavern | |
---|---|---|
1 | 76 | |
50,198 | 5,427 | |
- | 12.7% | |
- | 10.0 | |
6 days ago | 3 days ago | |
Python | JavaScript | |
Apache License 2.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
privateGPT
-
PrivateGPT exploring the Documentation
# install developer tools xcode-select --install # create python sandbox mkdir PrivateGTP cd privateGTP/ python3 -m venv . # actiavte local context source bin/activate # privateGTP uses poetry for python module management privateGTP> pip install poetry # sync privateGTP project privateGTP> git clone https://github.com/imartinez/privateGPT # enable MPS for model loading and processing privateGTP> CMAKE_ARGS="-DLLAMA_METAL=on" pip install --force-reinstall --no-cache-dir llama-cpp-python privateGTP> cd privateGPT # Import configure python dependencies privateGTP> poetry run python3 scripts/setup # launch web interface to confirm operational on default model privateGTP> python3 -m private_gpt # navigate safari browser to http://localhost:8001/ # To bulk import documentation needed to stop the web interface as vector database not in multi-user mode privateGTP> [control] + "C" # import some PDFs privateGTP> curl "https://docs.intersystems.com/irislatest/csp/docbook/pdfs.zip" -o /tmp/pdfs.zip privateGTP> unzip /tmp/pdfs.zip -d /tmp # took a few hours to process privateGTP> make ingest /tmp/pdfs/pdfs/ # launch web interface again for query documentation privateGTP> python3 -m private_gpt
SillyTavern
-
Claude 3 beats GPT-4 on Aider's code editing benchmark β aider
Right, but it's certainly easier for people who might not even know what "API" stands for, and that's quite nifty. As far as self-hosted frontends go, I can personally recommend SillyTavern[1] in the browser, ChatterUI[2] on mobile, and ShellGPT[3] for CLI. LobeChat looks pretty cool, though! I'll definitely check it out.
[1] https://github.com/SillyTavern/SillyTavern
- FLaNK AI for 11 March 2024
- Show HN: I made an app to use local AI as daily driver
-
Group chats vs online defined characters, token efficiency question
I don't think there is any enumeration for {{char}} macros. Here is some good discussion on the subject.
-
Is possible to run local voice chat agent? If yes what GPU do i Need with 500β¬ budget?
As for SillyTavern, you need the main SillyTavern frontend and SillyTavern-extras (for TTS, STT, etc.) They're pretty easy to install. SillyTavern connects to oobabooga and SillyTavern-extras via API.
-
What do you use to run your models?
Finally, no matter what backend I use, I need it to be compatible with my power-user frontend, SillyTavern. That way I always use the same UI, with the characters I created and extensions I want, e. g. web search, XTTS text-to-speech and Whisper speech recognition for real-time voice chat - and all of that local!
- SillyTavern 1.10.10 has been released
- LM Studio β Discover, download, and run local LLMs
-
πΊπ¦ββ¬ LLM Comparison/Test: Mistral 7B Updates (OpenHermes 2.5, OpenChat 3.5, Nous Capybara 1.9)
SillyTavern v1.10.5 frontend (not the latest as I don't want to upgrade mid-test)
-
LLM Pro/Serious Use Comparison/Test: From 7B to 70B vs. ChatGPT!
SillyTavern v1.10.4 frontend
What are some alternatives?
TavernAI - TavernAI for nerds [Moved to: https://github.com/Cohee1207/SillyTavern]
character-editor - Create, edit and convert AI character files for CharacterAI, Pygmalion, Text Generation, KoboldAI and TavernAI
TavernAI - Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
SillyTavern-extras - Extensions API for SillyTavern [Moved to: https://github.com/SillyTavern/SillyTavern-extras]
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
SillyTavern-Extras - Extensions API for SillyTavern.
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
chroma - the AI-native open-source embedding database
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
KoboldAI
llama.cpp - LLM inference in C/C++
GirlfriendGPT - Girlfriend GPT is a Python project to build your own AI girlfriend using ChatGPT4.0