efficient-attention
a-PyTorch-Tutorial-to-Image-Captioning
efficient-attention | a-PyTorch-Tutorial-to-Image-Captioning | |
---|---|---|
1 | 1 | |
253 | 2,657 | |
- | - | |
1.8 | 0.0 | |
over 3 years ago | almost 2 years ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
efficient-attention
-
Efficient Visual Self-Attention - Link to a free online lecture by the author in comments
Efficient attention: https://arxiv.org/abs/1812.01243 https://github.com/cmsflash/efficient-attention
a-PyTorch-Tutorial-to-Image-Captioning
-
[R] end-to-end image captioning
I have found this repository: https://github.com/sgrvinod/a-PyTorch-Tutorial-to-Image-Captioning that, seemingly, requires only images and captions, but this is quite old (3 years ago), and is based on LSTMs. I was hoping there are transformers-based implementations that I could use.
What are some alternatives?
vit-pytorch - Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
meshed-memory-transformer - Meshed-Memory Transformer for Image Captioning. CVPR 2020
performer-pytorch - An implementation of Performer, a linear attention-based transformer, in Pytorch
BLIP - PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
DALLE-pytorch - Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
image-to-latex - Convert images of LaTex math equations into LaTex code.
pytorch-tutorial - PyTorch Tutorial for Deep Learning Researchers
catr - Image Captioning Using Transformer
clip-glass - Repository for "Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search"
blip - A tool for seeing your Internet latency. Try it at http://gfblip.appspot.com/
Machine-Learning-Collection - A resource for learning about Machine learning & Deep Learning