Fast-Transformer VS Perceiver

reformer-pytorch - Reformer, the efficient Transformer, in Pytorch

Swin-Transformer-Object-Detection - This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Object Detection and Instance Segmentation.

Conformer - An implementation of Conformer: Convolution-augmented Transformer for Speech Recognition, a Transformer Variant in TensorFlow/Keras

performer-pytorch - An implementation of Performer, a linear attention-based transformer, in Pytorch

TimeSformer-pytorch - Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

deepmind-perceiver - My implementation of DeepMind's Perceiver

Transformer-in-Transformer - An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

machine-learning-experiments - 🤖 Interactive Machine Learning experiments: 🏋️models training + 🎨models demo

gato - Unofficial Gato: A Generalist Agent

language-planner - Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

conformer - Implementation of the convolutional module from the Conformer paper, for use in Transformers