attention-is-all-you-need-pytorch VS long-range-arena

Compare attention-is-all-you-need-pytorch vs long-range-arena and see what are their differences.

attention-is-all-you-need-pytorch

A PyTorch implementation of the Transformer model in "Attention is All You Need". (by jadore801120)

long-range-arena

Long Range Arena for Benchmarking Efficient Transformers (by google-research)
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
attention-is-all-you-need-pytorch long-range-arena
3 6
8,350 677
- 3.6%
0.0 0.0
6 months ago 3 months ago
Python Python
MIT License Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

attention-is-all-you-need-pytorch

Posts with mentions or reviews of attention-is-all-you-need-pytorch. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-10-10.

long-range-arena

Posts with mentions or reviews of long-range-arena. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-17.

What are some alternatives?

When comparing attention-is-all-you-need-pytorch and long-range-arena you can also consider the following projects:

performer-pytorch - An implementation of Performer, a linear attention-based transformer, in Pytorch

LFattNet - Attention-based View Selection Networks for Light-field Disparity Estimation

jax-resnet - Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).

HJxB - Continuous-Time/State/Action Fitted Value Iteration via Hamilton-Jacobi-Bellman (HJB)

BERT-pytorch - Google AI 2018 BERT pytorch implementation

OpenPrompt - An Open-Source Framework for Prompt-Learning.

scenic - Scenic: A Jax Library for Computer Vision Research and Beyond

tldr-transformers - The "tl;dr" on a few notable transformer papers (pre-2022).

flaxmodels - Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.

elegy - A High Level API for Deep Learning in JAX

allennlp - An open-source NLP research library, built on PyTorch.