A fast inference library for running LLMs locally on modern consumer-class GPUs (by turboderp)

Exllamav2 Alternatives

Similar projects and alternatives to exllamav2

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better exllamav2 alternative or higher similarity.

exllamav2 reviews and mentions

Posts with mentions or reviews of exllamav2. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-09-12.


Basic exllamav2 repo stats
5 days ago

turboderp/exllamav2 is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of exllamav2 is Python.

Popular Comparisons

Updating dependencies is time-consuming.
Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.