Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)
Here you can share your experience with the project you are suggesting or its comparison with do-you-even-need-attention. Optional.
A valid email to send you a verification link when necessary or log in.