recurrent-memory-transformer-pytorch
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch (by lucidrains)
MEGABYTE-pytorch
Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch (by lucidrains)
| recurrent-memory-transformer-pytorch | MEGABYTE-pytorch | |
|---|---|---|
| 1 | 1 | |
| 381 | 591 | |
| - | - | |
| 7.4 | 4.4 | |
| 3 months ago | 5 days ago | |
| Python | Python | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
recurrent-memory-transformer-pytorch
Posts with mentions or reviews of recurrent-memory-transformer-pytorch.
We have used some of these posts to build our list of alternatives
and similar projects.
-
The race is on
Of course, lucidrains already has an empty repo up. So that's worth keeping an eye on.
MEGABYTE-pytorch
Posts with mentions or reviews of MEGABYTE-pytorch.
We have used some of these posts to build our list of alternatives
and similar projects.
What are some alternatives?
When comparing recurrent-memory-transformer-pytorch and MEGABYTE-pytorch you can also consider the following projects:
musiclm-pytorch - Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
iTransformer - Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks, out of Tsinghua / Ant group
muse-maskgit-pytorch - Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
toolformer-pytorch - Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
phenaki-pytorch - Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch