LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss. (by microsoft)

LLMLingua Alternatives

Similar projects and alternatives to LLMLingua

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better LLMLingua alternative or higher similarity.

LLMLingua reviews and mentions

Posts with mentions or reviews of LLMLingua. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-03-25.

Stats

Basic LLMLingua repo stats
3
3,774
8.3
15 days ago

microsoft/LLMLingua is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of LLMLingua is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com