KoboldCPP Updated to Support K-Quants, new bonus CUDA build.

• koboldcpp

  180 3,887 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• SillyTavern

  75 677 10.0 JavaScript

  Discontinued LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern] (by Cohee1207)

  

I'm using SillyTavern frontend and simple-proxy-for-tavern with koboldcpp. Not sure which of these has solved the prompt-reprocessing problem, but I no longer have these slowdowns.

• SurveyJS

  surveyjs.io featured

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• simple-proxy-for-tavern

  21 111 8.0 JavaScript

I'm using SillyTavern frontend and simple-proxy-for-tavern with koboldcpp. Not sure which of these has solved the prompt-reprocessing problem, but I no longer have these slowdowns.

Suggest a related project