aimet
tkDNN
aimet | tkDNN | |
---|---|---|
2 | 3 | |
2,195 | 718 | |
1.5% | - | |
9.8 | 3.6 | |
4 days ago | over 1 year ago | |
Python | C++ | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aimet
-
I was looking for some great quantization open-source libraries that could actually be applied in production (both edge or cloud CPU/GPU). Do you know if I am missing any good libraries?
Qualcomm AIMET | Advanced quantization and compression techniques for trained neural network models
-
Model/Tool to use on Jetson for efficient Quantization/Pruning
Qualcomm AIMET may help you
tkDNN
-
Model/Tool to use on Jetson for efficient Quantization/Pruning
Develop your own tkDNN solution. Try it out and improve it. And improve your hardware if possible.
-
[P] Tutorial: Real-time YOLOv3 on a Laptop Using Sparse Quantization
Build the repository. Get the dependencies installed and then follow https://github.com/ceccocats/tkDNN#how-to-compile-this-repo
-
Problem with live inference with tkDNN tensorRT Yolov4 (raspberry pi v2 camera)
Hey guys, today I tried to experiment with TensorRT on Darknet Object Detection Models like Yolov4. I followed the instructions over at https://github.com/ceccocats/tkDNN/. and the recommended darkent fork found here: https://git.hipert.unimore.it/fgatti/darknet
What are some alternatives?
model-optimization - A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
qkeras - QKeras: a quantization deep learning library for Tensorflow Keras
ludwig - Low-code framework for building custom LLMs, neural networks, and other AI models
open-lpr - Open Source and Free License Plate Recognition Software
distiller - Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
orion - Asynchronous Distributed Hyperparameter Optimization.
optimate - A collection of libraries to optimise AI model performances
Model-Compression-Research-Package - A library for researching neural networks compression and acceleration methods.
nylon - An intelligent, flexible grammar of machine learning.
elasticsearch-stress-test - Stress test tool for Elasticsearch