Introducing llamacpp-for-kobold, run llama.cpp locally with a fancy web UI, persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios and more with minimal setup.

• llama.cpp

  769 55,846 10.0 C++

  LLM inference in C/C++

There's an important fix for 65B models upstream: https://github.com/ggerganov/llama.cpp/pull/438/files. I've verified it works on my local copy. Can your fork be updated from upstream? Without it llama will segfault to an under-estimate of the memory required.

• llamacpp-for-kobold

  8 96 10.0 C

  Discontinued Port of Facebook's LLaMA model in C/C++ [Moved to: https://github.com/LostRuins/koboldcpp]

Enter llamacpp-for-kobold

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• koboldcpp

  2 15 10.0 C++

  Port of Facebook's LLaMA model in C/C++ (by henk717)

There's also a single file version, where you just drag-and-drop your llama model onto the .exe file, and connect KoboldAI to the displayed link.

• TavernAI

  17 76 10.0 JavaScript

  Discontinued TavernAI for nerds [Moved to: https://github.com/Cohee1207/SillyTavern] (by SillyLossy)

It looks like some endpoints are missing that flavors of TavernAI depend on. E.g., this promising version of TavernAI needs /config/soft_prompts

Suggest a related project