A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Here you can share your experience with the project you are suggesting or its comparison with text-generation-webui. Optional.
A valid email to send you a verification link when necessary or log in.