An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Here you can share your experience with the project you are suggesting or its comparison with AutoGPTQ. Optional.
A valid email to send you a verification link when necessary or log in.