A fork of textgen that still supports V1 GPTQ, 4-bit lora and other GPTQ models besides llama.
Why do you think that https://github.com/Ph0rk0z/GPTQ-Merged is a good alternative to text-generation-webui-testing
A fork of textgen that still supports V1 GPTQ, 4-bit lora and other GPTQ models besides llama.
Why do you think that https://github.com/Ph0rk0z/GPTQ-Merged is a good alternative to text-generation-webui-testing