Awesome-Pruning-at-Initialization Alternatives

Similar projects and alternatives to Awesome-Pruning-at-Initialization based on common topics and language

Torch-Pruning

2 2,307 9.4 Python Awesome-Pruning-at-Initialization VS Torch-Pruning

[CVPR 2023] Towards Any Structural Pruning; LLMs / SAM / Diffusion / Transformers / YOLOv8 / CNNs
UPop

1 83 8.4 Python Awesome-Pruning-at-Initialization VS UPop

[ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Awesome-Knowledge-Distillation

1 2,396 0.0 Awesome-Pruning-at-Initialization VS Awesome-Knowledge-Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
efficient-dl-systems

1 578 7.7 Jupyter Notebook Awesome-Pruning-at-Initialization VS efficient-dl-systems

Efficient Deep Learning Systems course materials (HSE, YSDA)
efficient-gnns

2 525 0.0 Python Awesome-Pruning-at-Initialization VS efficient-gnns

Code and resources on scalable and efficient Graph Neural Networks
nni

5 13,742 6.7 Python Awesome-Pruning-at-Initialization VS nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
Efficient-AI-Backbones

3 3,804 5.8 Python Awesome-Pruning-at-Initialization VS Efficient-AI-Backbones

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Awesome-Pruning-at-Initialization alternative or higher similarity.

Suggest an alternative to Awesome-Pruning-at-Initialization

Awesome-Pruning-at-Initialization reviews and mentions

Posts with mentions or reviews of Awesome-Pruning-at-Initialization. We have used some of these posts to build our list of alternatives and similar projects.

[R] SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
1 project | /r/MachineLearning | 28 Jan 2023

Yeah, there is some stuff published out there. It's related to pruning (A link to a ton of papers on it); the lottery ticket method solves this one well, because you're re-training from scratch, just with "lucky" selection of the initialized weights. Results-wise, I never got anything to improve because of the distributional changes caused by trying to re-randomize a subset in the middle of training. Still saw the same level of performance as without re-randomizing, but that basically just showed that the way that I was re-randomizing wasn't helping or hurting b/c those neurons weren't important...