ModelZoo.pytorch
simpleT5
| ModelZoo.pytorch | simpleT5 | |
|---|---|---|
| 1 | 2 | |
| 48 | 381 | |
| - | - | |
| 0.0 | 2.5 | |
| over 3 years ago | 12 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ModelZoo.pytorch
-
[D] Any good resources/repositories to get ImageNet trained models?
Google for 'model zoo' and the terms you want. Here's one that comes up with label smoothing: https://github.com/PistonY/ModelZoo.pytorch
simpleT5
-
Transformers: How to compare performance to base model?
Currently I just took ~42000 samples and trained a translation task directly on codeT5 with https://github.com/Shivanandroy/simpleT5. Validation loss and at least the qualitative results are not to bad. Im now going to try to compare it to the base codeT5-model with the *.loss function as suggested above.
-
[P] SimpleT5 : Train T5 models in just 3 lines of code
🌟GitHub: https://github.com/Shivanandroy/simpleT5 🌟Medium: https://snrspeaks.medium.com/simplet5-train-t5-models-in-just-3-lines-of-code-by-shivanand-roy-2021-354df5ae46ba 🌟Colab Notebook: https://colab.research.google.com/drive/1JZ8v9L0w0Ai3WbibTeuvYlytn0uHMP6O?usp=sharing
What are some alternatives?
mmpretrain - OpenMMLab Pre-training Toolbox and Benchmark
reformer-pytorch - Reformer, the efficient Transformer, in Pytorch
pytorch2keras - PyTorch to Keras model convertor
datatap-python - Focus on Algorithm Design, Not on Data Wrangling
models - Models and examples built with TensorFlow
frame-semantic-transformer - Frame Semantic Parser based on T5 and FrameNet
segmentation_models - Segmentation models with pretrained backbones. Keras and TensorFlow Keras.
KeyPhraseTransformer - KeyPhraseTransformer lets you quickly extract key phrases, topics, themes from your text data with T5 transformer | Keyphrase extraction | Keyword extraction
MEAL-V2 - MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.
TencentPretrain - Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
fastT5 - ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.