SaaSHub helps you find the best software and product alternatives Learn more →
Exllama Alternatives
Similar projects and alternatives to exllama
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
exllama
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better exllama alternative or higher similarity.
exllama reviews and mentions
Posts with mentions or reviews of exllama.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-27.
-
exlamma? Questions about stuff 4bit and things
But you also need to manually install https://github.com/0cc4m/exllama/releases/tag/0.0.5 by opening the KoboldAI command prompt and running the "pip install" command followed by the whl file you downloaded.
- Anyone tried this promising sounding release? WizardLM-33B-V1.0-Uncensored-SUPERHOT-8K
- How is ExLlama so good? Can it be used with a more feature rich UI?
- Damn, I was so satisfied with my 3080 with 10GB of VRAM until I found this subreddit.
- EXLlama test on 2x4090, Windows 11 and Ryzen 7 7800X3D
-
A note from our sponsor - SaaSHub
www.saashub.com | 10 May 2024
Stats
Basic exllama repo stats
6
7
9.0
6 months ago
0cc4m/exllama is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of exllama is Python.
Popular Comparisons
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com