Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
Here you can share your experience with the project you are suggesting or its comparison with AutoGPTQ-API. Optional.
A valid email to send you a verification link when necessary or log in.