A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Why do you think that https://github.com/ollama/ollama is a good alternative to text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Why do you think that https://github.com/ollama/ollama is a good alternative to text-generation-webui