catai
koboldcpp
| catai | koboldcpp | |
|---|---|---|
| 7 | 180 | |
| 408 | 3,817 | |
| 1.7% | - | |
| 8.6 | 10.0 | |
| 3 months ago | 7 days ago | |
| TypeScript | C++ | |
| MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
catai
-
Are you sure you are focusing on the right things? (venting)
The easiest tool I found is CatAI: https://github.com/ido-pluto/catai You just type 3 npm commands and THATS IT! You have your own Chat Web UI on your computer without hundrets of settings
- How to use CatAI to apologize to your boss
-
Wizard-Vicuna-13B-Uncensored
I am a noob. I saw your comment on github and another post here. I am confused about what has changed and what us users have to do. Do we have to update llama.cpp and redownload all the models(I am using something called catai instead of the webui, i think it also uses llama.cpp)? How do we know which versions of the models are compatible with which vesions of llama.cpp?
-
Google removes the waitlist on Bard today and will be available in 180 more countries
https://github.com/ggerganov/llama.cpp https://github.com/oobabooga/text-generation-webui https://github.com/mlc-ai/mlc-llm https://github.com/cocktailpeanut/dalai https://github.com/ido-pluto/catai (this is super easy to install but it doesnt provide an api or have integration with langchain)
-
GPT For All 13B (/GPT4All-13B-snoozy-GPTQ) is Completely Uncensored, a great model
Pretty simple using catai.
- How to run something like chatgpt, locally?
-
How to install Wizard-Vicuna
You can check out the original GitHub project here
koboldcpp
- Any Online Communities on Local/Home AI?
- Koboldcpp-1.62.1 adds support for Command-R+
- Show HN: I made an app to use local AI as daily driver
-
Easiest way to show my model to my mom?
FYI this is the easiest way to host on the horde: https://github.com/LostRuins/koboldcpp
- IT Veteran... why am I struggling with all of this?
- What do you use to run your models?
- ByteDance AI researcher suggests that open source model more powerful than Gemini to be released soon
- i need some help guys
-
[Guide] How install KoboldAI in Android via Termux (Update 04-12-2023)
For more information of Koboldcpp look this guide: https://github.com/LostRuins/koboldcpp/wiki
-
SillyTavern 1.10.10 has been released
Out of curiosity, is there a specific reason for this? The most popular fork KoboldCpp is in active development, and was the first to adopt the Min P sampler, and even distincts itself with the context shift feature. Just wondering what this means for the future. Thanks!
What are some alternatives?
alpaca-electron - The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer
KoboldAI
HyunGPT - chatbot thing
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
AutoGPTQ - An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
TavernAI - Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
llama.cpp - LLM inference in C/C++
KoboldAI - KoboldAI is generative AI software optimized for fictional use, but capable of much more!
dalai - The simplest way to run LLaMA on your local machine
ChatRWKV - ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
mlc-llm - Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]