attention-gym

Helpful tools and examples for working with flex-attention (by pytorch-labs)
Review Suggest topics
Source Code
attention-gym Reviews
Suggest alternative
Edit details
Save 47% on cloud hosting with autoscaling that just works
Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.
judoscale.com
featured

Attention-gym Alternatives

Similar projects and alternatives to attention-gym

pytorch-labs
attention-gym

  1. Pytorch

    387 attention-gym VS Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

  2. Judoscale

    Save 47% on cloud hosting with autoscaling that just works. Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.

    Judoscale logo

  3. transit-python3

    2 attention-gym VS transit-python3

    Fork of transit-python2

  4. csp

    3 attention-gym VS csp

    csp is a high performance reactive stream processing library, written in C++ and Python

  5. art-deco

    1 attention-gym VS art-deco

  6. svd_util

    3 attention-gym VS svd_util

    python utulity funcs, classes, small languages, frameworks, scripts. i tend to use most optz, attr, struct, py3, eutf

  7. paip-python

    1 attention-gym VS paip-python

    Peter Norvig's Paradigms of AI Programming implemented in Python

  8. lightning-thunder

    3 attention-gym VS lightning-thunder

    Thunder gives you PyTorch models superpowers for training and inference. Unlock out-of-the-box optimizations for performance, memory and parallelism, or roll out your own.

  9. InfluxDB

    InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.

    InfluxDB logo

  10. pypy

    2 attention-gym VS pypy

    PyPy is a very fast and compliant implementation of the Python language.

  11. python-dsls

    2 attention-gym VS python-dsls

    Materials for the talk "Python already has a frontend for your compiler" at PiterPy 2023

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better attention-gym alternative or higher similarity.
Suggest an alternative to attention-gym

attention-gym discussion

Log in or Post with

attention-gym reviews and mentions

Posts with mentions or reviews of attention-gym. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2025-02-03.
  • Decorator JITs: Python as a DSL
    10 projects | news.ycombinator.com | 3 Feb 2025
    Basically this style of code - https://github.com/pytorch-labs/attention-gym/pull/84/files - has issues like this - https://github.com/pytorch/pytorch/pull/137452 https://github.com/pytorch/pytorch/issues/144511 https://github.com/pytorch/pytorch/issues/145869

    For some higher level context, see https://pytorch.org/blog/flexattention/

  • FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention
    1 project | news.ycombinator.com | 8 Aug 2024
    Agreed that PyTorch tutorials are a great place to start. Specific to flexattention, the blog references the accompanying attention gym, which has a series of examples of how to use flex: https://github.com/pytorch-labs/attention-gym/

Stats

Basic attention-gym repo stats
2
720
7.9
10 days ago

pytorch-labs/attention-gym is an open source project licensed under BSD 3-clause "New" or "Revised" License which is an OSI approved license.

The primary programming language of attention-gym is Python.

Popular Comparisons

  1. attention-gym VS transit-python3
  2. attention-gym VS art-deco
  3. attention-gym VS paip-python
  4. attention-gym VS csp
  5. attention-gym VS svd_util
  6. attention-gym VS pypy

Sponsored
Save 47% on cloud hosting with autoscaling that just works
Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.
judoscale.com
Loading...