semantra
SillyTavern
semantra | SillyTavern | |
---|---|---|
17 | 75 | |
2,289 | 677 | |
- | - | |
4.9 | 10.0 | |
12 days ago | 12 months ago | |
Python | JavaScript | |
MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
semantra
- Semantra: Multi-Tool for Semantic Search
-
Show HN: SeaGOAT – local, “AI-based” grep for semantic code search
Semantra! Shared it yesterday on HN https://github.com/freedmand/semantra
- Show HN: Semantra – local, private semantic search engine for your files
-
Serverless Semantic Search, Free tier only
[2] https://github.com/freedmand/semantra (author of this tool)
-
My experience on starting with fine tuning LLMs with custom data
Yep, same. This works decently well: https://github.com/freedmand/semantra
-
Document digest & oobabooga
I've been wondering how long it'd take this project to add support for something like Semantra so I'm glad you're into it.
-
Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern)
It's kind of like a more more applicable version of Semantra for content generation.
-
ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
That's a big part of the reason I built the open source tool Semantra[1]. I only really trust the semantic search part of this problem as it is constrained by context, so I tried to make the user experience good on top of simpler semantic search without any chatbot capabilities.
[1] https://github.com/freedmand/semantra
-
Best model to act as info hub for preppers?
My dream assistant would be one that can search through these offline files and bring back relevant information. I think the closest we have to this is the Semantra project.
-
VRAM limitations
Here, I'll be very blunt: I don't see any of these "The quick brown WizardLM jumps over the lazy Vicuna (Matata)" etc exciting much more people than just the member count of this subreddit any more than the already practically usable (and runs on even the low end iGPUs) kinda tools like Semantra.
SillyTavern
-
Help😢
Go to Termix and click Exit. Then go to Termux and code 1. Apk update 2. Apk upgrade 3. git clone https://github.com/Cohee1207/SillyTavern 4. cd SillyTavern 5. Install nodejs 6. Npm install 7. Node server
-
Oogabooga and llama.cpp in longer conversations answers take forever.....
If you want the best roleplaying experience, I can only recommend SillyTavern with SillyTavern/SillyTavern-extras. The extras include summarization and ChromaDB, both helping to get longer and more coherent chats.
-
koboldcpp-1.33 Ultimate Edition released!
Really? Then we definitely have different experiences (or different ways to interact) with Guanaco. It's been the most unrestricted model I've tried, and I tried them all, but I'm using SillyTavern and the simple-proxy-for-tavern which combined with a little prompting liberates basically any model.
-
The best 13B model for rolepay?
Why reinvent the wheel? Just use SillyTavern, ideally with the simple-proxy-for-tavern. That does it all, and more.
-
airoboros gpt4 v1.2
I tested this today in an hours-long direct roleplay comparison between q3_K_M quants of TheBloke/airoboros-65B-gpt4-1.2-GGML and TheBloke/guanaco-65B-GGML, using koboldcpp as backend together with simple-proxy-for-tavern and SillyTavern as frontend.
-
What are you using for RP?
I'm using SillyTavern frontend and simple-proxy-for-tavern with koboldcpp backend.
-
KoboldCPP Updated to Support K-Quants, new bonus CUDA build.
I'm using SillyTavern frontend and simple-proxy-for-tavern with koboldcpp. Not sure which of these has solved the prompt-reprocessing problem, but I no longer have these slowdowns.
-
What are your favorite LLMs?
WizardLM 30B V1.0 is not only smarter and follows instructions better than the others, it's even uncensored when used with an uncensoring character card (I use SillyTavern as my GUI/frontend) - more so than any other model I tested. Probably because it follows instructions so well, thus roleplaying an uncensored character properly (and not breaking character or going "as an AI" even once during my tests).
-
Potato's brain guide to installing and reopening SillyTavern for Mac
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.3/install.sh | bash export NVM_DIR="$([ -z "${XDG_CONFIG_HOME-}" ] && printf %s "${HOME}/.nvm" || printf %s "${XDG_CONFIG_HOME}/nvm")" [ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh" nvm install node git clone -b dev https://github.com/Cohee1207/SillyTavern && cd SillyTavern npm i && node server.js
-
I've found a solution to Poe API error
For Android (Termux users): 1. apt update 2. apt upgrade 3. Type "y" to everything and hit enter 4. pkg install git 5. git clone -b dev https://github.com/Cohee1207/SillyTavern 6. cd SillyTavern 7. pkg install nodejs 8. npm install 9. bash start.sh
What are some alternatives?
SeaGOAT - local-first semantic code search engine
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
uniteai - Your AI Stack in Your Editor
TavernAI - TavernAI for nerds [Moved to: https://github.com/Cohee1207/SillyTavern]
terraform-aws-lambd
langflow - ⛓️ Langflow is a dynamic graph where each node is an executable unit. Its modular and interactive design fosters rapid experimentation and prototyping, pushing hard on the limits of creativity.
GPTQ-for-LLaMa - 4 bits quantization of LLaMa using GPTQ
character-editor - Create, edit and convert AI character files for CharacterAI, Pygmalion, Text Generation, KoboldAI and TavernAI
chatdocs - Chat with your documents offline using AI.
simple-proxy-for-tavern
SillyTavern - LLM Frontend for Power Users.
ChatRWKV - ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.