koboldcpp
A simple one-file way to run various GGML and GGUF models with KoboldAI's UI (by LostRuins)
SillyTavern
LLM Frontend for Power Users. (by SillyTavern)
| koboldcpp | SillyTavern | |
|---|---|---|
| 180 | 76 | |
| 3,817 | 5,930 | |
| - | 8.5% | |
| 10.0 | 10.0 | |
| 2 days ago | 3 days ago | |
| C++ | JavaScript | |
| GNU Affero General Public License v3.0 | GNU Affero General Public License v3.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
koboldcpp
Posts with mentions or reviews of koboldcpp.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-02-27.
- Any Online Communities on Local/Home AI?
- Koboldcpp-1.62.1 adds support for Command-R+
- Show HN: I made an app to use local AI as daily driver
-
Easiest way to show my model to my mom?
FYI this is the easiest way to host on the horde: https://github.com/LostRuins/koboldcpp
- IT Veteran... why am I struggling with all of this?
- What do you use to run your models?
- ByteDance AI researcher suggests that open source model more powerful than Gemini to be released soon
- i need some help guys
-
[Guide] How install KoboldAI in Android via Termux (Update 04-12-2023)
For more information of Koboldcpp look this guide: https://github.com/LostRuins/koboldcpp/wiki
-
SillyTavern 1.10.10 has been released
Out of curiosity, is there a specific reason for this? The most popular fork KoboldCpp is in active development, and was the first to adopt the Min P sampler, and even distincts itself with the context shift feature. Just wondering what this means for the future. Thanks!
SillyTavern
Posts with mentions or reviews of SillyTavern.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-27.
-
Claude 3 beats GPT-4 on Aider's code editing benchmark – aider
Right, but it's certainly easier for people who might not even know what "API" stands for, and that's quite nifty. As far as self-hosted frontends go, I can personally recommend SillyTavern[1] in the browser, ChatterUI[2] on mobile, and ShellGPT[3] for CLI. LobeChat looks pretty cool, though! I'll definitely check it out.
[1] https://github.com/SillyTavern/SillyTavern
[2] https://github.com/Vali-98/ChatterUI
[3] https://github.com/TheR1D/shell_gpt
- FLaNK AI for 11 March 2024
- Show HN: I made an app to use local AI as daily driver
-
Group chats vs online defined characters, token efficiency question
I don't think there is any enumeration for {{char}} macros. Here is some good discussion on the subject.
- SillyTavern 1.11.0 has been released
-
Is possible to run local voice chat agent? If yes what GPU do i Need with 500€ budget?
As for SillyTavern, you need the main SillyTavern frontend and SillyTavern-extras (for TTS, STT, etc.) They're pretty easy to install. SillyTavern connects to oobabooga and SillyTavern-extras via API.
-
What do you use to run your models?
Finally, no matter what backend I use, I need it to be compatible with my power-user frontend, SillyTavern. That way I always use the same UI, with the characters I created and extensions I want, e. g. web search, XTTS text-to-speech and Whisper speech recognition for real-time voice chat - and all of that local!
- SillyTavern 1.10.10 has been released
- LM Studio – Discover, download, and run local LLMs
-
🐺🐦⬛ LLM Comparison/Test: Mistral 7B Updates (OpenHermes 2.5, OpenChat 3.5, Nous Capybara 1.9)
SillyTavern v1.10.5 frontend (not the latest as I don't want to upgrade mid-test)
What are some alternatives?
When comparing koboldcpp and SillyTavern you can also consider the following projects:
KoboldAI
TavernAI - TavernAI for nerds [Moved to: https://github.com/Cohee1207/SillyTavern]
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
character-editor - Create, edit and convert AI character files for CharacterAI, Pygmalion, Text Generation, KoboldAI and TavernAI
TavernAI - Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
KoboldAI
SillyTavern-extras - Extensions API for SillyTavern [Moved to: https://github.com/SillyTavern/SillyTavern-extras]
ChatRWKV - ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]
SillyTavern-Extras - Extensions API for SillyTavern.
koboldcpp vs KoboldAI
SillyTavern vs TavernAI
koboldcpp vs text-generation-webui
SillyTavern vs character-editor
koboldcpp vs TavernAI
SillyTavern vs TavernAI
koboldcpp vs KoboldAI
SillyTavern vs SillyTavern-extras
koboldcpp vs ChatRWKV
SillyTavern vs text-generation-webui
koboldcpp vs SillyTavern
SillyTavern vs SillyTavern-Extras