FQ-ViT VS SqueezeLLM

Compare FQ-ViT vs SqueezeLLM and see what are their differences.

FQ-ViT

[IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer (by megvii-research)
vision-transformer quantization post-training-quantization Pytorch Imagenet
Source Code
Suggest alternative
Edit details

SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization (by SqueezeAILab)
efficient-inference generative-inference large-language-models llm model-compression Natural Language Processing post-training-quantization quantization text-generation Transformer
Source Code
arxiv.org
Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
FQ-ViT SqueezeLLM
2 5
263 569
0.4% 3.3%
1.1 6.9
about 1 year ago 7 days ago
Python Python
Apache License 2.0 MIT License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

FQ-ViT

Posts with mentions or reviews of FQ-ViT. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-06-20.
  • How to quantize a Swin transformer model?
    3 projects | /r/deeplearning | 20 Jun 2022
    This my implementation on the approach I shared( https://github.com/megvii-research/FQ-ViT ) on a small dataset from kaggle(link: https://www.kaggle.com/datasets/gauravduttakiit/ants-bees) in this notebook :https://colab.research.google.com/drive/1cqnmosPIVZu3e2SwbO_VbevANk5MppVS?usp=sharing

SqueezeLLM

Posts with mentions or reviews of SqueezeLLM. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-05.

What are some alternatives?

When comparing FQ-ViT and SqueezeLLM you can also consider the following projects:

Efficient-AI-Backbones - Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

llm-awq - AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Sparsebit - A model compression and acceleration toolbox based on pytorch.

Qwen-7B - The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud. [Moved to: https://github.com/QwenLM/Qwen]

transformer-quantization

Qwen - The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

Pretrained-Language-Model - Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

GoLLIE - Guideline following Large Language Model for Information Extraction

LLMCompiler - [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

LocalMentor - Local Startup Advisor Chatbot

FQ-ViT vs Efficient-AI-Backbones SqueezeLLM vs llm-awq FQ-ViT vs Sparsebit SqueezeLLM vs Qwen-7B FQ-ViT vs transformer-quantization SqueezeLLM vs Qwen SqueezeLLM vs Pretrained-Language-Model SqueezeLLM vs GoLLIE SqueezeLLM vs LLMCompiler SqueezeLLM vs LocalMentor