Trying to run TheBloke/vicuna-13B-1.1-GPTQ-4bit-128g with latest GPTQ-for-LLaMa CUDA branch

• GPTQ-for-LLaMa

  19 129 7.7 Python

  4 bits quantization of LLaMa using GPTQ (by oobabooga)

git clone https://github.com/oobabooga/GPTQ-for-LLaMa.git -b cuda

• GPTQ-for-LLaMa

  75 2,913 8.6 Python

  4 bits quantization of LLaMA using GPTQ

git clone https://github.com/qwopqwop200/GPTQ-for-LLaMa -b cuda

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project