FunMatch-Distillation
poolformer
| FunMatch-Distillation | poolformer | |
|---|---|---|
| 1 | 3 | |
| 79 | 1,226 | |
| - | 0.0% | |
| 1.8 | 0.0 | |
| over 2 years ago | over 1 year ago | |
| Jupyter Notebook | Jupyter Notebook | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
FunMatch-Distillation
-
Knowledge distillation with "Function Matching"
There's a notebook on distributed hyperparameter tuning and it's often not included in the public release of an implementation.
poolformer
-
Researchers from Sea AI Lab and National University of Singapore Introduce ‘PoolFormer’: A Derived Model from MetaFormer for Computer Vision Tasks
GitHub: https://github.com/sail-sg/poolformer
-
[D] Are Image Transformers Overhyped? "MetaFormer is all you need" explained (5-minute summary by Casual GAN Papers)
arxiv / code
-
[P] Fine-tuning the new PoolFormer (MetaFormer) model on a Kaggle Competitions Dataset
Code for https://arxiv.org/abs/2111.11418 found: https://github.com/sail-sg/poolformer
What are some alternatives?
Practical_RL - A course in reinforcement learning in the wild
pytorch-seq2seq - Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
TFLiteClassification - TensorFlow Lite Image Classification Python Implementation
SpecVQGAN - Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)
PAWS-TF - Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.
HugsVision - HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision
adanet - Fast and flexible AutoML with learning guarantees.
One-Piece-Image-Classifier - A quick image classifier trained with manually selected One Piece images.
Transformer-in-Transformer - An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches
ru-dalle - Generate images from texts. In Russian
TokenCut - (CVPR 2022) Pytorch implementation of "Self-supervised transformers for unsupervised object discovery using normalized cut"