Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Exllama Alternatives
Similar projects and alternatives to exllama
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
-
exllama
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better exllama alternative or higher similarity.
exllama reviews and mentions
Posts with mentions or reviews of exllama.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-27.
-
exlamma? Questions about stuff 4bit and things
But you also need to manually install https://github.com/0cc4m/exllama/releases/tag/0.0.5 by opening the KoboldAI command prompt and running the "pip install" command followed by the whl file you downloaded.
- Anyone tried this promising sounding release? WizardLM-33B-V1.0-Uncensored-SUPERHOT-8K
- How is ExLlama so good? Can it be used with a more feature rich UI?
- Damn, I was so satisfied with my 3080 with 10GB of VRAM until I found this subreddit.
- EXLlama test on 2x4090, Windows 11 and Ryzen 7 7800X3D
-
A note from our sponsor - InfluxDB
www.influxdata.com | 1 Jun 2024
Stats
Basic exllama repo stats
6
7
9.0
7 months ago
0cc4m/exllama is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of exllama is Python.
Popular Comparisons
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com