llamacpp-for-kobold VS TavernAI

Geben Sie llamacpp-for-kobold ein

30b (alpacacpp and Kobold-TavernAI on windows, this one)

I am the creator of https://github.com/LostRuins/llamacpp-for-kobold . It runs a local http server serving a koboldai compatible api with a built in webui. Compatible with all llama.cpp and alpaca.cpp models.

I don't know if anything like that exists. There is this project that I played around with at one point if that helps at all.

Try this https://github.com/LostRuins/llamacpp-for-kobold

What does it mean? You get an embedded llama.cpp with a fancy writing UI, persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios and everything Kobold and Kobold Lite have to offer. In a tiny package (under 1 MB compressed with no dependencies except python), excluding model weights. Simply download, extract, and run the llama-for-kobold.py file with the 4bit quantized llama model.bin as the second parameter.

Enter llamacpp-for-kobold

I keep getting this last code after I input "git clone https://github.com/SillyLossy/TavernAI" what am I supposed to do..?

It's already the case with games like Silly Tavern https://github.com/SillyLossy/TavernAI and AI girls that are created on https://www.characterhub.org for AI personalities. Basically 4chan people use open source AI models like meta's Llama.cpp to create horny personalities to interact with, and use local models with SD to create big boobed waifus.

1) Download Termux scroll down and look for download apk, install it. 2) Type in or copy and paste and hit enter apt update Enter, Press y to anything that comes up 3) Type in or copy and paste and hit enter apt update Enter, Press y to anything that comes up 4) Type in or copy and paste and hit enter pkg install git 5) Type in or copy and paste and hit enter git clone https://github.com/SillyLossy/TavernAI 6) Optional to get the most updated stuff add the dev branch if you just want it basic just skip this step Type in or copy and paste and hit enter git clone -b dev https://github.com/SillyLossy/TavernAI 7) Type in or copy and paste and hit enter cd SillyTavern The caps and lowercase HAS to specifically be this way. If you get green /SillyTavern you did it correctly. 8) Type in or copy and paste and hit enter pkg install nodejs 9) Type in or copy and paste and hit enter npm install 10) Type in or copy and paste and hit enter node server.js It should open your browser. You have correctly installed SillyTavern onto Termux. Under the plug you can click this link https://platform.openai.com/account/api-keys sign in and copy paste the link/api key

But if you're really serious about chatting, the best experience is definitely with TavernAI. It's just a frontend so you still run the AI using oobabooga's textgen or one of the *cpp engines, but because it's entirely focused on chatting, its chat capabilities are much more advanced.

Have you tried to talk to both at the same time? With TavernAI group chats are actually possible. The current version isn't compatible with koboldcpp, but the dev version has a fix, and I'm just getting started playing around with it.

That looks like Cohee's TavernAI fork! https://github.com/SillyLossy/TavernAI