SaaSHub helps you find the best software and product alternatives Learn more →
Hqq Alternatives
Similar projects and alternatives to hqq based on common topics and language
-
NeoGPT
Chat effortlessly, execute commands, and interpret code with Llama3, Phi3, and more - your local AI assistant. Enjoy seamless interaction while ensuring ultimate privacy
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
-
aimet
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
-
model-optimization
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
hqq reviews and mentions
-
Half-Quadratic Quantization of Large Machine Learning Models
Sharing our work on model quantization.
- Blog: https://mobiusml.github.io/hqq_blog/
-
New Mixtral HQQ Quantzied 4-bit/2-bit configuration
We are releasing new 2-bit Mixtral models. These ones use a mixed HQQ 4-bit/2-bit configuration, resulting in a significantly improved model (ppl 4.69 vs. 5.90) with a negligible 0.20 GB VRAM increase.
Base: https://huggingface.co/mobiuslabsgmbh/Mixtral-8x7B-v0.1-hf-a...
Instruct: https://huggingface.co/mobiuslabsgmbh/Mixtral-8x7B-Instruct-...
Shout-out to Artem Eliseev and Denis Mazur for suggesting this idea ( https://github.com/mobiusml/hqq/issues/2 )
-
[D] Which framework do you use for applying post-training quantization on image classification models?
Haven't used it myself yet, but https://github.com/mobiusml/hqq looks quite promising, and, more importantly for me, easy to use
-
[R] Half-Quadratic Quantization of Large Machine Learning Models
Blog: https://mobiusml.github.io/hqq_blog/ Code: https://github.com/mobiusml/hqq Models: https://huggingface.co/mobiuslabsgmbh/
-
A note from our sponsor - SaaSHub
www.saashub.com | 8 May 2024
Stats
mobiusml/hqq is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of hqq is Python.
Sponsored