neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime (by intel)

Neural-compressor Alternatives

Similar projects and alternatives to neural-compressor

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better neural-compressor alternative or higher similarity.

neural-compressor discussion

Log in or Post with

neural-compressor reviews and mentions

Posts with mentions or reviews of neural-compressor. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-07-26.

Stats

Basic neural-compressor repo stats
3
2,138
9.7
4 days ago

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com

Did you konow that Python is
the 1st most popular programming language
based on number of metions?