Sparsednn Alternatives

Similar projects and alternatives to sparsednn

transformer-deploy

8 1,615 6.8 Python sparsednn VS transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
TensorRT

5 2,328 9.6 Python sparsednn VS TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT (by pytorch)
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
mmrazor

4 1,361 2.8 Python sparsednn VS mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better sparsednn alternative or higher similarity.

Suggest an alternative to sparsednn

sparsednn reviews and mentions

Posts with mentions or reviews of sparsednn. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-12-28.

[P] 4.5 times faster Hugging Face transformer inference by modifying some Python AST
4 projects | /r/MachineLearning | 28 Dec 2021

If you are ever interested in looking at pruning, happy to integrate my open source library https://github.com/marsupialtail/sparsednn. Latest update has unstructured and structured sparse int8 kernels. 3x speedup over dense int8 at 90 percent sparsity with 1x4 blocks.