poolformer
Transformer-in-Transformer
poolformer | Transformer-in-Transformer | |
---|---|---|
3 | 4 | |
1,226 | 41 | |
0.0% | - | |
0.0 | 0.0 | |
over 1 year ago | about 2 years ago | |
Jupyter Notebook | Jupyter Notebook | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
poolformer
-
Researchers from Sea AI Lab and National University of Singapore Introduce ‘PoolFormer’: A Derived Model from MetaFormer for Computer Vision Tasks
GitHub: https://github.com/sail-sg/poolformer
-
[D] Are Image Transformers Overhyped? "MetaFormer is all you need" explained (5-minute summary by Casual GAN Papers)
arxiv / code
-
[P] Fine-tuning the new PoolFormer (MetaFormer) model on a Kaggle Competitions Dataset
Code for https://arxiv.org/abs/2111.11418 found: https://github.com/sail-sg/poolformer
Transformer-in-Transformer
- I Implemented Transformer in Transformer
-
Hacker News top posts: Dec 6, 2021
I Implemented Transformer in Transformer\ (5 comments)
- [P] I implemented Transformer in Transformer
What are some alternatives?
pytorch-seq2seq - Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
LongNet - Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
SpecVQGAN - Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)
AvatarGAN - Generate Cartoon Images using Generative Adversarial Network
HugsVision - HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision
swarms - Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Real World Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
TFLiteClassification - TensorFlow Lite Image Classification Python Implementation
principia - The Principia Rewrite
FunMatch-Distillation - TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.
planckforth - Bootstrapping a Forth interpreter from hand-written tiny ELF binary. Just for fun.
ru-dalle - Generate images from texts. In Russian
Fast-Transformer - An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow