I was looking for some great quantization open-source libraries that could actually be applied in production (both edge or cloud CPU/GPU). Do you know if I am missing any good libraries?

1. TensorRT

   1 23 11,038 6.6 C++

   NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

   

   Nvidia Quantization | Quantization with TensorRT

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. optimate

   2 105 8,376 5.8 Python

   A collection of libraries to optimise AI model performances

   

   Nebullvm | Easy-to-use library to boost AI inference leveraging state-of-the-art optimization techniques

4. aimet

   3 2 2,197 9.8 Python

   AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

   

   Qualcomm AIMET | Advanced quantization and compression techniques for trained neural network models

5. Model-Compression-Research-Package

   4 1 138 3.4 Python

   A library for researching neural networks compression and acceleration methods.

   

   Intel Labs compression | Researching neural networks compression and acceleration methods.

Suggest a related project