guidance
koboldcpp
| guidance | koboldcpp | |
|---|---|---|
| 6 | 180 | |
| 43 | 3,817 | |
| - | - | |
| 9.0 | 10.0 | |
| 11 months ago | 3 days ago | |
| Jupyter Notebook | C++ | |
| MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
guidance
-
Would local LLMs in the future be able to run an Ai powered single player roleplaying adventure game in a customized world?
There is also a fork to allow easy use with llama.cpp: https://github.com/Maximilian-Winter/guidance (use his matching llama-cpp-python fork as well). You can also use it with GPTQ for GPU-accelerated GPTQ-quantized models.
-
Can someone explain why there isn't a good interface for the oobabooga api in langchain?
Did you see that someone had ported guidance to llamacpp? I saw someone trying to make it happen with ooga but I don't think they are as far as the llamacpp guy got. https://github.com/Maximilian-Winter/guidance
-
Best model for game "AI agent"?
Something like this with Manticore13B or some of the models you've already tried: https://github.com/Maximilian-Winter/guidance
- Hi community, I created a fork of microsoft's guidance and added llama-cpp-python support!
koboldcpp
- Any Online Communities on Local/Home AI?
- Koboldcpp-1.62.1 adds support for Command-R+
- Show HN: I made an app to use local AI as daily driver
-
Easiest way to show my model to my mom?
FYI this is the easiest way to host on the horde: https://github.com/LostRuins/koboldcpp
- IT Veteran... why am I struggling with all of this?
- What do you use to run your models?
- ByteDance AI researcher suggests that open source model more powerful than Gemini to be released soon
- i need some help guys
-
[Guide] How install KoboldAI in Android via Termux (Update 04-12-2023)
For more information of Koboldcpp look this guide: https://github.com/LostRuins/koboldcpp/wiki
-
SillyTavern 1.10.10 has been released
Out of curiosity, is there a specific reason for this? The most popular fork KoboldCpp is in active development, and was the first to adopt the Min P sampler, and even distincts itself with the context shift feature. Just wondering what this means for the future. Thanks!
What are some alternatives?
agnai - AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.
KoboldAI
gptq-cuda-api
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
llama-cpp-python - Python bindings for llama.cpp
TavernAI - Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
AgentOoba - An autonomous AI agent extension for Oobabooga's web ui
KoboldAI
GPTQ-for-LLaMa-API - Provide a way to use the GPT-QLLama model as an API
ChatRWKV - ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]
exllama - A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.