FlashAttention-2, 2x faster than FlashAttention

• stable-diffusion-webui

  2,808 129,299 9.9 Python

  Stable Diffusion web UI

It looks like it's already at thing https://github.com/AUTOMATIC1111/stable-diffusion-webui/blob...

• GPU-Puzzles

  12 5,022 3.4 Jupyter Notebook

  Solve puzzles. Learn CUDA.

I found it helpful to start with CUDA on numba since it lets you write GPU kernels in python. Assuming you're like most ML engineers and you're more familiar with python than C++, this allows you to separately learn CUDA concepts from also learning C++ at the same time. There's also a set of GPU puzzles for beginners [1] using to get started with numba CUDA.

[1] https://github.com/srush/GPU-Puzzles

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• xformers

  46 7,578 9.3 Python

  Hackable and optimized Transformers building blocks, supporting a composable construction.

  

This enables V1. V2 is still yet to be integrated into xformers. The team replied saying it should happen this week.

See the relevant Github issue here: https://github.com/facebookresearch/xformers/issues/795

Suggest a related project