Transformer-in-Transformer VS poolformer

Compare Transformer-in-Transformer vs poolformer and see what are their differences.

Transformer-in-Transformer

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches (by Rishit-dagli)
Machine Learning attention-mechanism Transformer tnt image-classification sota Tensorflow neural-networks Deep Learning Artificial intelligence
Source Code
pypi.org
Suggest alternative
Edit details

poolformer

PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral) (by sail-sg)
Transformer mlp pooling image-classification Pytorch
Source Code
arxiv.org
Suggest alternative
Edit details
WorkOS
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors
Transformer-in-Transformer poolformer
4 3
41 1,226
- 1.6%
0.0 0.0
about 2 years ago over 1 year ago
Jupyter Notebook Jupyter Notebook
Apache License 2.0 Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

Transformer-in-Transformer

Posts with mentions or reviews of Transformer-in-Transformer. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-12-06.

poolformer

Posts with mentions or reviews of poolformer. We have used some of these posts to build our list of alternatives and similar projects.

What are some alternatives?

When comparing Transformer-in-Transformer and poolformer you can also consider the following projects:

LongNet - Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

pytorch-seq2seq - Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

AvatarGAN - Generate Cartoon Images using Generative Adversarial Network

SpecVQGAN - Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)

swarms - Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Real World Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD

HugsVision - HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision

principia - The Principia Rewrite

TFLiteClassification - TensorFlow Lite Image Classification Python Implementation

planckforth - Bootstrapping a Forth interpreter from hand-written tiny ELF binary. Just for fun.

FunMatch-Distillation - TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.

Fast-Transformer - An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow

ru-dalle - Generate images from texts. In Russian

Transformer-in-Transformer vs LongNet poolformer vs pytorch-seq2seq Transformer-in-Transformer vs AvatarGAN poolformer vs SpecVQGAN Transformer-in-Transformer vs swarms poolformer vs HugsVision Transformer-in-Transformer vs principia poolformer vs TFLiteClassification Transformer-in-Transformer vs planckforth poolformer vs FunMatch-Distillation Transformer-in-Transformer vs Fast-Transformer poolformer vs ru-dalle