open-llms
SillyTavern-Extras
open-llms | SillyTavern-Extras | |
---|---|---|
22 | 14 | |
10,168 | 485 | |
- | 5.2% | |
7.7 | 9.6 | |
about 1 month ago | 8 days ago | |
Python | ||
Apache License 2.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
open-llms
-
7 SAAS ideas 💡 you can steal
Everyone knows about ChatGPT by now, but did you know there are other models like "Mistral" or "Falcon" - you can view a full list of open-source models here or on huggingface.
- eugeneyan/open-llms
-
GPT-4 API general availability
This is the most well-maintained list of commercially usable open LLMs: https://github.com/eugeneyan/open-llms
MPT, OpenLLaMA, and Falcon are probably the most generally useful.
For code, Replit Code (specifically replit-code-instruct-glaive) and StarCoder (WizardCoder-15B) are the current top open models and both can be used commercially.
-
Local LLMs: After Novelty Wanes
There's also MPT, which has a 7B, and Falcon, with a 7B and 40B although they have not had the inference tuning in community projects that the llamas have had. This is a good repo for reviewing what's available atm: https://github.com/eugeneyan/open-llms
- How to keep track of all the LLMs out there?
-
How do I learn AI/Machine Learning?
If I was going to do the same I would at least build off of something, check out https://github.com/eugeneyan/open-llms, you should at least have a decent understanding of artificial neural networks (ANNs) and this link is pretty good on the basic concepts you need inc classification and learning types, good luck friend.
- LLM and privacy
- Local LLM to learn, explore and use for commercial purpose
-
Best instruct model recommendations to use with T4?
This list might help: https://github.com/eugeneyan/open-llms
- [D] What is the best open source LLM so far?
SillyTavern-Extras
-
Is possible to run local voice chat agent? If yes what GPU do i Need with 500€ budget?
As for SillyTavern, you need the main SillyTavern frontend and SillyTavern-extras (for TTS, STT, etc.) They're pretty easy to install. SillyTavern connects to oobabooga and SillyTavern-extras via API.
- Image upload in ST
-
Poe Problem
Sure, best bet is to follow the instructions on the ST extra's github. It gives a good step by step guide to setting up and running all the addon's. Here is a link in case you need it. https://github.com/SillyTavern/SillyTavern-extras
-
What is the best text web ui currently?
oobazz + SillyTavern
-
Oogabooga and llama.cpp in longer conversations answers take forever.....
If you want the best roleplaying experience, I can only recommend SillyTavern with SillyTavern/SillyTavern-extras. The extras include summarization and ChromaDB, both helping to get longer and more coherent chats.
-
I finally got SillyTavern set up... now what? How do I set the scene? How do I build the world?
If you haven't already, I sugget you to instal SillyTavern Extra which you can add objective with task, character expression ( personally I generate expression with stable diffusion), and text to speech to diffrent character. You can also set a group scenario if you create group.
-
Looking for the long-term memory extension.
Instead, I use the summarize extension for SillyTavern, which is serviceable: https://github.com/SillyTavern/SillyTavern-extras
-
FINISHED IT!! my final tier list..
It doesn't have to be the end. Do what I'm doing and get SillyTavern, use their extension (for expressive sprites), open an OAI account, create some Umineko bots, import your own sprites, and start chatting with them. There's been a lot of advancements in AI visual novel tech. Here's me and the UI's creator in a 5-way group chat with the Quintessential Quintuplets.
- Local LLMs: After Novelty Wanes
-
New to SillyTavern, I have a few question, sorry if they are silly. Pun intended.
The sillytavern-extras: https://github.com/SillyTavern/SillyTavern-extras Classify-extension handles expression, provided you have the pictures. The clever model mentioned in the readme can handle 28 different expressions. It evaluates *while generating* so it can change the pic of 'current speaker', so it'll change as speakers change. I've not spent much time with the group chat, so I never figured out how to do it like it was meant to. BTW, of extras, chromadb is cool, look into it.
What are some alternatives?
SillyTavern - LLM Frontend for Power Users.
long_term_memory - A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
llm-jeopardy - Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
stable-diffusion-webui - Stable Diffusion web UI
azure-search-openai-demo - A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
lollms-webui - Lord of Large Language Models Web User Interface
panml - PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
simple-proxy-for-tavern
code-eval - Run evaluation on LLMs using human-eval benchmark
docker - Docker - the open-source application container engine