D2L_Attention_Mechanisms_in_TF
Perceiver
| D2L_Attention_Mechanisms_in_TF | Perceiver | |
|---|---|---|
| 7 | 7 | |
| 12 | 85 | |
| - | - | |
| 0.0 | 2.6 | |
| over 2 years ago | about 3 years ago | |
| Jupyter Notebook | Python | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
D2L_Attention_Mechanisms_in_TF
- [P] Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
- Project [P] Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
- Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
- [P] Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book. Github link: https://github.com/biswajitsahoo1111/D2L_Attention_Mechanisms_in_TF
Perceiver
- I implemented Deepmind's new Perceiver Model
- I Implemented Deepmind's Perceiver Model
-
[P] I implemented DeepMind's "Perceiver" in PyTorch
Great one, I implemented the Perceiver model too in TensorFlow: https://github.com/Rishit-dagli/Perceiver
- Deepmind's New Perceiver Model
-
[P] Implementing Perceiver: General perception with Iterative Attention in TensorFlow
The project: https://github.com/Rishit-dagli/Perceiver
- Perceiver, General Perception with Iterative Attention
What are some alternatives?
NLP-With-PyTorch - My NLP experiments using PyTorch to solve some common NLP problems with advanced and state of the art deep learning techniques.
Swin-Transformer-Object-Detection - This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Object Detection and Instance Segmentation.
TokenCut - (CVPR 2022) Pytorch implementation of "Self-supervised transformers for unsupervised object discovery using normalized cut"
performer-pytorch - An implementation of Performer, a linear attention-based transformer, in Pytorch
pytorch-GAT - My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
Fast-Transformer - An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow
gpt-mini - Yet another minimalistic Tensorflow (re-)re-implementation of Karpathy's Pytorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer).
TimeSformer-pytorch - Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification
gato - Unofficial Gato: A Generalist Agent
deepmind-perceiver - My implementation of DeepMind's Perceiver
conformer - Implementation of the convolutional module from the Conformer paper, for use in Transformers
EQTransformer - EQTransformer, a python package for earthquake signal detection and phase picking using AI.