vision_transformer_tf
Transformer-in-Transformer
| vision_transformer_tf | Transformer-in-Transformer | |
|---|---|---|
| 4 | 4 | |
| 24 | 41 | |
| - | - | |
| 10.0 | 0.0 | |
| over 1 year ago | about 2 years ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vision_transformer_tf
-
Implemented Vision Transformers from scratch using TensorFlow 2. x 🚀, Finetuning and Converting to TF-Lite ✅
Hi r/learnmachinelearning, I am done implementing the paper AN IMAGE IS WORTH 16X16 WORDS: TRANSFORMERS FOR IMAGE RECOGNITION AT SCALE, popularly known as the Vision Transformer paper. Using my implementation any vision transformer model can be finetuned pretty easily with any custom dataset, Converting weights to TensorFlow Lite is also supported. My codebase is also very straightforward to understand and debug. One can learn how the vision transformer works internally by debugging the whole pipeline. Link to the GitHub Project: https://github.com/TheTensorDude/vision_transformer_tf
-
[P] Finetune any Vision Transformer architecture on your custom data 🚀, Convert to TensorFlow Lite ✅
The GitHub link to the project can be found here.
-
[P] Implemented Vision Transformers 🚀 from scratch using TensorFlow 2.x
My implementation: GitHub Link
-
Implemented Vision Transformers 🚀 from scratch using TensorFlow 2.x
My implementation: https://github.com/TheTensorDude/vision_transformer_tf
Transformer-in-Transformer
- I Implemented Transformer in Transformer
-
Hacker News top posts: Dec 6, 2021
I Implemented Transformer in Transformer\ (5 comments)
- [P] I implemented Transformer in Transformer
What are some alternatives?
maxvit - [ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...
poolformer - PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
coral-pi-rest-server - Perform inferencing of tensorflow-lite models on an RPi with acceleration from Coral USB stick
LongNet - Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
saliency - Framework-agnostic implementation for state-of-the-art saliency methods (XRAI, BlurIG, SmoothGrad, and more).
AvatarGAN - Generate Cartoon Images using Generative Adversarial Network
TFLiteClassification - TensorFlow Lite Image Classification Python Implementation
swarms - Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Real World Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
gpt-mini - Yet another minimalistic Tensorflow (re-)re-implementation of Karpathy's Pytorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer).
principia - The Principia Rewrite
planckforth - Bootstrapping a Forth interpreter from hand-written tiny ELF binary. Just for fun.
Fast-Transformer - An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow