What are your favorite LLMs?

• SillyTavern

  75 677 10.0 JavaScript

  Discontinued LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern] (by Cohee1207)

  

WizardLM 30B V1.0 is not only smarter and follows instructions better than the others, it's even uncensored when used with an uncensoring character card (I use SillyTavern as my GUI/frontend) - more so than any other model I tested. Probably because it follows instructions so well, thus roleplaying an uncensored character properly (and not breaking character or going "as an AI" even once during my tests).

• koboldcpp

  180 3,887 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

I'm using TheBloke/WizardLM-30B-GGML with koboldcpp 1.29.

• SurveyJS

  surveyjs.io featured

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• Local-LLM-Comparison-Colab-UI

  20 886 9.1 Jupyter Notebook

  Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

My entire list at: Local LLM Comparison Repo

• simple-proxy-for-tavern

  21 111 8.0 JavaScript

Another option is to use anon998/simple-proxy-for-tavern. It's a much more advanced solutions and streaming is just one of its features.

Suggest a related project