sparsednn
mmrazor
| sparsednn | mmrazor | |
|---|---|---|
| 1 | 4 | |
| 51 | 1,365 | |
| - | 1.4% | |
| 0.0 | 2.8 | |
| over 1 year ago | 20 days ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sparsednn
-
[P] 4.5 times faster Hugging Face transformer inference by modifying some Python AST
If you are ever interested in looking at pruning, happy to integrate my open source library https://github.com/marsupialtail/sparsednn. Latest update has unstructured and structured sparse int8 kernels. 3x speedup over dense int8 at 90 percent sparsity with 1x4 blocks.
mmrazor
-
MMDeploy: Deploy All the Algorithms of OpenMMLab
MMRazor: OpenMMLab model compression toolbox and benchmark.
- Still worrying about model compression? MMRazor may work for you.
- Still worrying about model compression? MMRazor is all you need
-
[P] 4.5 times faster Hugging Face transformer inference by modifying some Python AST
https://github.com/open-mmlab/mmrazor ,it may work for you~
What are some alternatives?
transformer-deploy - Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
TensorRT - PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
neural-compressor - SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
mmaction2 - OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
Pointnet_Pointnet2_pytorch - PointNet and PointNet++ implemented by pytorch (pure python) and on ModelNet, ShapeNet and S3DIS.
PaddleViT - :robot: PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+
ttach - Image Test Time Augmentation with PyTorch!
mmrotate - OpenMMLab Rotated Object Detection Toolbox and Benchmark
mmcv - OpenMMLab Computer Vision Foundation
pytorch2keras - PyTorch to Keras model convertor