Transformer-Models-from-Scratch
tf-transformers
Our great sponsors
| Transformer-Models-from-Scratch | tf-transformers | |
|---|---|---|
| 1 | 5 | |
| 58 | 84 | |
| - | - | |
| 0.0 | 1.7 | |
| almost 2 years ago | about 1 year ago | |
| Jupyter Notebook | Jupyter Notebook | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Transformer-Models-from-Scratch
-
[D] Transformer-Models-from-Scratch
Transformer-Models-from-Scratch
tf-transformers
-
Tensorflow-Transformers 2.0 ( for NLP, CV, Audio )
Code : GitHub - legacyai/tf-transformers: State of the art faster Natural Language Processing in Tensorflow 2.0 . 1 Website : https://legacyai.github.io/tf-transformers 1
- [P] Production Ready NLP Deep learning tutorials on tensorflow 2.0. tf-transformers
- Do we really need to Dstill Language Models? Joint loss is all we need - Albert-Joint .
-
tf-transformers : State of the art faster NLP in Tensorflow 2.0 . 80 % faster to existing TF based libraries.
Faster Auto Regressive Decoding using Tensorflow2. Faster than PyTorch in most experiments (V100 GPU). 80% faster compared to existing TF based libraries (relative difference) Refer benchmark code.
- [D] Why is tensorflow so hated on and pytorch is the cool kids framework?
What are some alternatives?
OpenNMT-py - Open Source Neural Machine Translation and (Large) Language Models in PyTorch
medspacy - Library for clinical NLP with spaCy.
pytorch-seq2seq - Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
flax - Flax is a neural network library for JAX that is designed for flexibility.
ganbert-pytorch - Enhancing the BERT training with Semi-supervised Generative Adversarial Networks in Pytorch/HuggingFace
MIRNet-TFJS - TensorFlow JS models for MIRNet for low-light💡 image enhancement
emotion-classifier - An attention-based BiLSTM for emotion classification.
bertviz - BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
BERT-for-Mobile - Compares the DistilBERT and MobileBERT architectures for mobile deployments.
gpt-3-simple-tutorial - Generate SQL from Natural Language Sentences using OpenAI's GPT-3 Model
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
minGPT-TF - A minimal TF2 re-implementation of the OpenAI GPT training