What is the best text web ui currently?

• SillyTavern

  76 6,108 10.0 JavaScript

  LLM Frontend for Power Users.

  

Must have been a while ago when you last checked since it got added with Release 1.7.0 three weeks ago. With simple-proxy-for-tavern it supported streaming for even longer, and I still prefer to use it with that because it streams character by character instead of token by token which feels smoother.

• simple-proxy-for-tavern

  21 111 8.0 JavaScript

Must have been a while ago when you last checked since it got added with Release 1.7.0 three weeks ago. With simple-proxy-for-tavern it supported streaming for even longer, and I still prefer to use it with that because it streams character by character instead of token by token which feels smoother.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• text-generation-webui

  876 36,827 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

anyone know what has the most models supported & fastest web ui? or atleast what everyone is using. Ive seen https://github.com/oobabooga/text-generation-webui and https://github.com/ParisNeo/lollms-webui.

• lollms-webui

  7 3,868 9.9 Vue

  Lord of Large Language Models Web User Interface

  

anyone know what has the most models supported & fastest web ui? or atleast what everyone is using. Ive seen https://github.com/oobabooga/text-generation-webui and https://github.com/ParisNeo/lollms-webui.

• SillyTavern-Extras

  14 485 9.6 Python

  Extensions API for SillyTavern.

  

oobazz + SillyTavern

• llama.cpp

  778 57,984 10.0 C++

  LLM inference in C/C++

I couldn't really tell you on that. I only run Linux and I've never tried to run it on Windows. I just get the source from the github and build it from there. I didn't even know there were pre-built binaries distributed.

• gpt4all

  139 64,901 9.8 C++

  gpt4all: run open-source LLMs anywhere

  

https://gpt4all.io/ is what I have been using and it is solid -- it's a locally installed app not a webUI though -- but same idea.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• magi_llm_gui

  4 39 8.7 Python

  A Qt GUI for large language models

Other than Ooba, this is my fav (and works with a TON of model architectures) -> https://github.com/shinomakoi/magi_llm_gui

Suggest a related project