TavernAI VS ChatRWKV

I keep getting this last code after I input "git clone https://github.com/SillyLossy/TavernAI" what am I supposed to do..?

It's already the case with games like Silly Tavern https://github.com/SillyLossy/TavernAI and AI girls that are created on https://www.characterhub.org for AI personalities. Basically 4chan people use open source AI models like meta's Llama.cpp to create horny personalities to interact with, and use local models with SD to create big boobed waifus.

1) Download Termux scroll down and look for download apk, install it. 2) Type in or copy and paste and hit enter apt update Enter, Press y to anything that comes up 3) Type in or copy and paste and hit enter apt update Enter, Press y to anything that comes up 4) Type in or copy and paste and hit enter pkg install git 5) Type in or copy and paste and hit enter git clone https://github.com/SillyLossy/TavernAI 6) Optional to get the most updated stuff add the dev branch if you just want it basic just skip this step Type in or copy and paste and hit enter git clone -b dev https://github.com/SillyLossy/TavernAI 7) Type in or copy and paste and hit enter cd SillyTavern The caps and lowercase HAS to specifically be this way. If you get green /SillyTavern you did it correctly. 8) Type in or copy and paste and hit enter pkg install nodejs 9) Type in or copy and paste and hit enter npm install 10) Type in or copy and paste and hit enter node server.js It should open your browser. You have correctly installed SillyTavern onto Termux. Under the plug you can click this link https://platform.openai.com/account/api-keys sign in and copy paste the link/api key

But if you're really serious about chatting, the best experience is definitely with TavernAI. It's just a frontend so you still run the AI using oobabooga's textgen or one of the *cpp engines, but because it's entirely focused on chatting, its chat capabilities are much more advanced.

Have you tried to talk to both at the same time? With TavernAI group chats are actually possible. The current version isn't compatible with koboldcpp, but the dev version has a fix, and I'm just getting started playing around with it.

That looks like Cohee's TavernAI fork! https://github.com/SillyLossy/TavernAI

Most LLMs actually do a decent job out of the box if you ask them for step by step instructions. Tree of tough is one way to improve the results, reflexion is another that can be used separate or additionally. The downside is that most models will run quickly into their token limit (around 2k for most). However the new SuperHot models can handle up to 8k and then there are the RMVK-Raven models, they are RNNs and not transformers like all the other LLMs and can theoretically handle infinite context lengths (but they loose "focus" after a while).

RWKV models inference: https://github.com/BlinkDL/ChatRWKV (fast CUDA).

I'm most interested in that last one. I think I heard the RWKV models are very fast, don't need much Ram, and can have huge context tokens, so maybe their 14b can work for me. I wasn't sure how ready for use they were though, but looking more into it, stuff like rwkv.cpp and ChatRWKV and a whole lot of other community projects are mentioned on their github.

You can use ChatRWKV v2 (https://github.com/BlinkDL/ChatRWKV) to run Raven🐦 (compatible with vanilla RWKV):

I feel compelled to summon /u/bo_peng here and to mention his work on RWKV. (See https://github.com/BlinkDL/ChatRWKV and related repos.)

Please test https://github.com/BlinkDL/ChatRWKV which is a good chatbot despite only trained on the Pile :)