GPTQ-Merged

trying to make sense of it (by Ph0rk0z)

GPTQ-Merged Alternatives

Similar projects and alternatives to GPTQ-Merged

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better GPTQ-Merged alternative or higher similarity.

GPTQ-Merged reviews and mentions

Posts with mentions or reviews of GPTQ-Merged. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-28.
  • Slow inference on R720 w/P40 (or not)?
    2 projects | /r/LocalLLaMA | 28 Jun 2023
    Also autograd from here: https://github.com/Ph0rk0z/text-generation-webui-testing/ and it's matching GPTQ: https://github.com/Ph0rk0z/GPTQ-Merged/tree/dual-model
  • Finetuning on multiple GPUs
    4 projects | /r/LocalLLaMA | 12 Jun 2023
    Probably need to add universal support to the native functions because it uses llama only. If you edit the load_llama functions in autograd py to use generic stuff like this: https://github.com/Ph0rk0z/GPTQ-Merged/blob/dual-model/src/alpaca_lora_4bit/autograd_4bit.py it has a good chance of working. Might need to also add trust_remote_code.

Stats

Basic GPTQ-Merged repo stats
2
2
8.1
7 months ago

The primary programming language of GPTQ-Merged is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com