pytorch-seq2seq
RASP
pytorch-seq2seq | RASP | |
---|---|---|
3 | 3 | |
5,169 | 265 | |
- | 3.4% | |
5.4 | 6.5 | |
3 months ago | 2 months ago | |
Jupyter Notebook | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pytorch-seq2seq
-
A Good Github Repo to Look at (CS388 Natural Language Processing)
I don't know how many people are taking CS388 NLP in Fall 2022, but the assignment is really putting lots of stress on me. I was searching some good materials to prepare for NLP class, and a really good resource to look at is this github repo: https://github.com/bentrevett/pytorch-seq2seq.
- [D] How to truly understand attention mechanism in transformers?
- [D] Resources for Understanding The Original Transformer Paper
RASP
-
Thinking Like Transformers
there's also an interpreter for RASP as described in the paper :) https://github.com/tech-srl/RASP
Sasha's blog (your link) has a nice walkthrough of long addition with RASP though!
I'm not sure if it's from the authors of the paper, but this appears to be that: https://github.com/tech-srl/RASP
- [D] How to truly understand attention mechanism in transformers?
What are some alternatives?
Time-Series-Forecasting-Using-LSTM - Time-Series Forecasting on Stock Prices using LSTM
tensor2tensor - Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
poolformer - PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
Behavior-Sequence-Transformer-Pytorch - This is a pytorch implementation for the BST model from Alibaba https://arxiv.org/pdf/1905.06874.pdf
ru-dalle - Generate images from texts. In Russian
sequitur - Library of autoencoders for sequential data
awesome-speech-recognition-speech-synthesis-papers - Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
pytorch-GAT - My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
Deep-Learning-Papers-Reading-Roadmap - Deep Learning papers reading roadmap for anyone who are eager to learn this amazing tech!
pytorch-sentiment-analysis - Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
Transformer-Models-from-Scratch - implementing various transformer models for various tasks