What are the best resources online to learn attention and transformers?

This page summarizes the projects mentioned and recommended in the original post on /r/computervision

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • vit-pytorch

    Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

  • For code implementation, check out this git repo. It contains fairly straightforward PyTorch implementations for various ViT papers with references.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Is it easier to go from Pytorch to TF and Keras than the other way around?

    1 project | /r/pytorch | 13 May 2023
  • Training CNN/VIT on very small dataset

    1 project | /r/learnmachinelearning | 11 Jul 2022
  • Transformers in RL

    2 projects | /r/reinforcementlearning | 15 Jun 2022
  • [P] Release the Vision Transformer Cookbook with Tensorflow ! (Thanks to @lucidrains)

    2 projects | /r/MachineLearning | 28 Mar 2022
  • [D] Surprisingly Simple SOTA Self-Supervised Pretraining - Masked Autoencoders Are Scalable Vision Learners by Kaiming He et al. explained (5-minute summary by Casual GAN Papers)

    1 project | /r/MachineLearning | 17 Nov 2021