reformer-pytorch
Reformer, the efficient Transformer, in Pytorch (by lucidrains)
Fast-Transformer
An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow (by Rishit-dagli)
| reformer-pytorch | Fast-Transformer | |
|---|---|---|
| 2 | 4 | |
| 2,058 | 146 | |
| - | - | |
| 1.8 | 0.0 | |
| 11 months ago | about 2 years ago | |
| Python | Jupyter Notebook | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
reformer-pytorch
Posts with mentions or reviews of reformer-pytorch.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-03-06.
-
[D] How to do Long Text ( > 10k tokens) Summarization?
The lucidrains implementation of Reformer can handle tens of thousands of tokens on Google Colab (with batch size 1).
-
[R]How to go about non-reproducible research?
This is what I call great code : https://github.com/lucidrains/reformer-pytorch
Fast-Transformer
Posts with mentions or reviews of Fast-Transformer.
We have used some of these posts to build our list of alternatives
and similar projects.
What are some alternatives?
When comparing reformer-pytorch and Fast-Transformer you can also consider the following projects:
vit-pytorch - Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Perceiver - Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow