[P] Compound sparsification: using pruning, quantization, and layer dropping to improve BERT performance

• sparseml

  12 1,976 9.6 Python

  Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

  

Hi u/_Arsenie_Boca_, definitely. Our recipes and sparse models along with the SparseZoo Python API to download them are open-sourced and the SparseZoo UI that can be used to explore them is free to use. The SparseML codebase to apply recipes enabling the creation of the sparse models is open sourced. The Sparsify codebase to create recipes through a UI is as well. And finally, the DeepSparse Engine's backend is closed sourced but free to use.

• sparsify

  1 315 7.7 Python

  ML model optimization product to accelerate inference.

  

Hi u/_Arsenie_Boca_, definitely. Our recipes and sparse models along with the SparseZoo Python API to download them are open-sourced and the SparseZoo UI that can be used to explore them is free to use. The SparseML codebase to apply recipes enabling the creation of the sparse models is open sourced. The Sparsify codebase to create recipes through a UI is as well. And finally, the DeepSparse Engine's backend is closed sourced but free to use.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• deepsparse

  21 2,873 9.5 Python

  Sparsity-aware deep learning inference runtime for CPUs

  

Hi u/_Arsenie_Boca_, definitely. Our recipes and sparse models along with the SparseZoo Python API to download them are open-sourced and the SparseZoo UI that can be used to explore them is free to use. The SparseML codebase to apply recipes enabling the creation of the sparse models is open sourced. The Sparsify codebase to create recipes through a UI is as well. And finally, the DeepSparse Engine's backend is closed sourced but free to use.

Suggest a related project