vision_transformer_tf
D2L_Attention_Mechanisms_in_TF
| vision_transformer_tf | D2L_Attention_Mechanisms_in_TF | |
|---|---|---|
| 4 | 7 | |
| 24 | 12 | |
| - | - | |
| 10.0 | 0.0 | |
| over 1 year ago | over 2 years ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vision_transformer_tf
-
Implemented Vision Transformers from scratch using TensorFlow 2. x π, Finetuning and Converting to TF-Lite β
Hi r/learnmachinelearning, I am done implementing the paper AN IMAGE IS WORTH 16X16 WORDS: TRANSFORMERS FOR IMAGE RECOGNITION AT SCALE, popularly known as the Vision Transformer paper. Using my implementation any vision transformer model can be finetuned pretty easily with any custom dataset, Converting weights to TensorFlow Lite is also supported. My codebase is also very straightforward to understand and debug. One can learn how the vision transformer works internally by debugging the whole pipeline. Link to the GitHub Project: https://github.com/TheTensorDude/vision_transformer_tf
-
[P] Finetune any Vision Transformer architecture on your custom data π, Convert to TensorFlow Lite β
The GitHub link to the project can be found here.
-
[P] Implemented Vision Transformers π from scratch using TensorFlow 2.x
My implementation: GitHub Link
-
Implemented Vision Transformers π from scratch using TensorFlow 2.x
My implementation: https://github.com/TheTensorDude/vision_transformer_tf
D2L_Attention_Mechanisms_in_TF
- [P] Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
- Project [P] Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
- Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
- [P] Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book. Github link: https://github.com/biswajitsahoo1111/D2L_Attention_Mechanisms_in_TF
What are some alternatives?
maxvit - [ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...
NLP-With-PyTorch - My NLP experiments using PyTorch to solve some common NLP problems with advanced and state of the art deep learning techniques.
coral-pi-rest-server - Perform inferencing of tensorflow-lite models on an RPi with acceleration from Coral USB stick
TokenCut - (CVPR 2022) Pytorch implementation of "Self-supervised transformers for unsupervised object discovery using normalized cut"
saliency - Framework-agnostic implementation for state-of-the-art saliency methods (XRAI, BlurIG, SmoothGrad, and more).
pytorch-GAT - My implementation of the original GAT paper (VeliΔkoviΔ et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
TFLiteClassification - TensorFlow Lite Image Classification Python Implementation
gpt-mini - Yet another minimalistic Tensorflow (re-)re-implementation of Karpathy's Pytorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer).