open-llms
SillyTavern
| open-llms | SillyTavern | |
|---|---|---|
| 22 | 76 | |
| 10,168 | 5,930 | |
| - | 8.5% | |
| 7.7 | 10.0 | |
| about 1 month ago | 3 days ago | |
| JavaScript | ||
| Apache License 2.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
open-llms
-
7 SAAS ideas 💡 you can steal
Everyone knows about ChatGPT by now, but did you know there are other models like "Mistral" or "Falcon" - you can view a full list of open-source models here or on huggingface.
- eugeneyan/open-llms
-
GPT-4 API general availability
This is the most well-maintained list of commercially usable open LLMs: https://github.com/eugeneyan/open-llms
MPT, OpenLLaMA, and Falcon are probably the most generally useful.
For code, Replit Code (specifically replit-code-instruct-glaive) and StarCoder (WizardCoder-15B) are the current top open models and both can be used commercially.
-
Local LLMs: After Novelty Wanes
There's also MPT, which has a 7B, and Falcon, with a 7B and 40B although they have not had the inference tuning in community projects that the llamas have had. This is a good repo for reviewing what's available atm: https://github.com/eugeneyan/open-llms
- How to keep track of all the LLMs out there?
-
How do I learn AI/Machine Learning?
If I was going to do the same I would at least build off of something, check out https://github.com/eugeneyan/open-llms, you should at least have a decent understanding of artificial neural networks (ANNs) and this link is pretty good on the basic concepts you need inc classification and learning types, good luck friend.
- LLM and privacy
- Local LLM to learn, explore and use for commercial purpose
-
Best instruct model recommendations to use with T4?
This list might help: https://github.com/eugeneyan/open-llms
- [D] What is the best open source LLM so far?
SillyTavern
-
Claude 3 beats GPT-4 on Aider's code editing benchmark – aider
Right, but it's certainly easier for people who might not even know what "API" stands for, and that's quite nifty. As far as self-hosted frontends go, I can personally recommend SillyTavern[1] in the browser, ChatterUI[2] on mobile, and ShellGPT[3] for CLI. LobeChat looks pretty cool, though! I'll definitely check it out.
[1] https://github.com/SillyTavern/SillyTavern
[2] https://github.com/Vali-98/ChatterUI
[3] https://github.com/TheR1D/shell_gpt
- FLaNK AI for 11 March 2024
- Show HN: I made an app to use local AI as daily driver
-
Group chats vs online defined characters, token efficiency question
I don't think there is any enumeration for {{char}} macros. Here is some good discussion on the subject.
- SillyTavern 1.11.0 has been released
-
Is possible to run local voice chat agent? If yes what GPU do i Need with 500€ budget?
As for SillyTavern, you need the main SillyTavern frontend and SillyTavern-extras (for TTS, STT, etc.) They're pretty easy to install. SillyTavern connects to oobabooga and SillyTavern-extras via API.
-
What do you use to run your models?
Finally, no matter what backend I use, I need it to be compatible with my power-user frontend, SillyTavern. That way I always use the same UI, with the characters I created and extensions I want, e. g. web search, XTTS text-to-speech and Whisper speech recognition for real-time voice chat - and all of that local!
- SillyTavern 1.10.10 has been released
- LM Studio – Discover, download, and run local LLMs
-
🐺🐦⬛ LLM Comparison/Test: Mistral 7B Updates (OpenHermes 2.5, OpenChat 3.5, Nous Capybara 1.9)
SillyTavern v1.10.5 frontend (not the latest as I don't want to upgrade mid-test)
What are some alternatives?
SillyTavern-Extras - Extensions API for SillyTavern.
TavernAI - TavernAI for nerds [Moved to: https://github.com/Cohee1207/SillyTavern]
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
character-editor - Create, edit and convert AI character files for CharacterAI, Pygmalion, Text Generation, KoboldAI and TavernAI
llm-jeopardy - Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
TavernAI - Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
azure-search-openai-demo - A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
SillyTavern-extras - Extensions API for SillyTavern [Moved to: https://github.com/SillyTavern/SillyTavern-extras]
panml - PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
code-eval - Run evaluation on LLMs using human-eval benchmark