KVQuant Alternatives

Similar projects and alternatives to KVQuant based on common topics and language

• LLaMA-Factory

  2 20,248 9.9 Python KVQuant VS LLaMA-Factory

  Unify Efficient Fine-Tuning of 100+ LLMs

• fltr

  3 337 8.9 Rust KVQuant VS fltr

  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• DeepCache

  1 603 8.9 Python KVQuant VS DeepCache

  [CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

• SqueezeLLM

  5 569 6.9 Python KVQuant VS SqueezeLLM

  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

  

• LLMCompiler

  2 1,069 7.6 Python KVQuant VS LLMCompiler

  LLMCompiler: An LLM Compiler for Parallel Function Calling

  

• xTuring

  31 2,523 8.4 Python KVQuant VS xTuring

  Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6