Transformer-Models-from-Scratch
pytorch-seq2seq
Our great sponsors
| Transformer-Models-from-Scratch | pytorch-seq2seq | |
|---|---|---|
| 1 | 3 | |
| 58 | 5,138 | |
| - | - | |
| 0.0 | 5.4 | |
| almost 2 years ago | 3 months ago | |
| Jupyter Notebook | Jupyter Notebook | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Transformer-Models-from-Scratch
-
[D] Transformer-Models-from-Scratch
Transformer-Models-from-Scratch
pytorch-seq2seq
-
A Good Github Repo to Look at (CS388 Natural Language Processing)
I don't know how many people are taking CS388 NLP in Fall 2022, but the assignment is really putting lots of stress on me. I was searching some good materials to prepare for NLP class, and a really good resource to look at is this github repo: https://github.com/bentrevett/pytorch-seq2seq.
- [D] How to truly understand attention mechanism in transformers?
- [D] Resources for Understanding The Original Transformer Paper
What are some alternatives?
OpenNMT-py - Open Source Neural Machine Translation and (Large) Language Models in PyTorch
Time-Series-Forecasting-Using-LSTM - Time-Series Forecasting on Stock Prices using LSTM
ganbert-pytorch - Enhancing the BERT training with Semi-supervised Generative Adversarial Networks in Pytorch/HuggingFace
tensor2tensor - Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
emotion-classifier - An attention-based BiLSTM for emotion classification.
poolformer - PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
tf-transformers - State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
Behavior-Sequence-Transformer-Pytorch - This is a pytorch implementation for the BST model from Alibaba https://arxiv.org/pdf/1905.06874.pdf
ru-dalle - Generate images from texts. In Russian
sequitur - Library of autoencoders for sequential data
awesome-speech-recognition-speech-synthesis-papers - Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
pytorch-GAT - My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!