Gptq-cuda-api Alternatives
Similar projects and alternatives to gptq-cuda-api
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better gptq-cuda-api alternative or higher similarity.
gptq-cuda-api reviews and mentions
Posts with mentions or reviews of gptq-cuda-api.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-25.
-
Example of how to run GPTQ models on multiple GPUs
Here is the repository with minimal code required to run GPTQ on multiple GPUs https://github.com/mzbac/gptq-cuda-api
-
Can someone explain why there isn't a good interface for the oobabooga api in langchain?
oobabooga has to support way too many models, so making the whole thing unnecessarily complicated. If you have some development experience, maybe you would build your own API in a few lines of Python code. It's not hard if you build from scratch and learn along the way. I have built some example repositories for hosting GPTQ-related models. You can have a look at them. https://github.com/mzbac/GPTQ-for-LLaMa-API https://github.com/mzbac/gptq-cuda-api
Stats
Basic gptq-cuda-api repo stats
2
19
3.9
11 months ago
The primary programming language of gptq-cuda-api is Python.
Popular Comparisons
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com