nested-transformer
Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf (by google-research)
FunMatch-Distillation
TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237. (by sayakpaul)
| nested-transformer | FunMatch-Distillation | |
|---|---|---|
| 1 | 1 | |
| 190 | 79 | |
| 0.0% | - | |
| 1.8 | 1.8 | |
| over 2 years ago | over 2 years ago | |
| Jupyter Notebook | Jupyter Notebook | |
| Apache License 2.0 | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nested-transformer
Posts with mentions or reviews of nested-transformer.
We have used some of these posts to build our list of alternatives
and similar projects.
FunMatch-Distillation
Posts with mentions or reviews of FunMatch-Distillation.
We have used some of these posts to build our list of alternatives
and similar projects.
-
Knowledge distillation with "Function Matching"
There's a notebook on distributed hyperparameter tuning and it's often not included in the public release of an implementation.
What are some alternatives?
When comparing nested-transformer and FunMatch-Distillation you can also consider the following projects:
poolformer - PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
Practical_RL - A course in reinforcement learning in the wild
TFLiteClassification - TensorFlow Lite Image Classification Python Implementation
PAWS-TF - Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.
adanet - Fast and flexible AutoML with learning guarantees.
One-Piece-Image-Classifier - A quick image classifier trained with manually selected One Piece images.