efficient-gnns
Torch-Pruning
efficient-gnns | Torch-Pruning | |
---|---|---|
2 | 2 | |
525 | 2,324 | |
- | - | |
0.0 | 9.4 | |
over 1 year ago | 11 days ago | |
Python | Python | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
efficient-gnns
- [R] Recent Advances in Efficient and Scalable Graph Neural Networks
-
[Project] Efficient and scalable Graph Neural Networks papers
Please help me improve it: https://github.com/chaitjo/awesome-efficient-gnn
Torch-Pruning
-
[P] Help: I want to compress EfficientnetV2 using pruning.
I also tried structured pruning from https://github.com/VainF/Torch-Pruning, as they report EfficientNetV2 to be "prunable", but got much worse results. However, the advantage of this approach is that it keeps the model dense, and you can get a real speed-up with common GPUs, while unstructured pruning sparsifies the model and you need hardware that can exploit such sparsity.
-
[D] What is your go-to implementation for structured pruning?
I'm currently using this repo and I find it very intuitive: https://github.com/VainF/Torch-Pruning. Not sure if it fits your needs, but check it out :)
What are some alternatives?
euler - A distributed graph deep learning framework.
SadTalker - [CVPR 2023] SadTalker:Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
gnn-lspe - Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022
only_train_once - OTOv1-v3, NeurIPS, ICLR, TMLR, DNN Training, Compression, Structured Pruning, Erasing Operators, CNN, Diffusion, LLM
awesome-drug-pair-scoring - Readings for "A Unified View of Relational Deep Learning for Drug Pair Scoring." (IJCAI 2022)
nni - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
GraphGPS - Recipe for a General, Powerful, Scalable Graph Transformer
UPop - [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
Painter - Painter & SegGPT Series: Vision Foundation Models from BAAI
openscene - [CVPR'23] OpenScene: 3D Scene Understanding with Open Vocabularies
Pretrained-Language-Model - Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
model-optimization - A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.