Flash-attention-minimal Alternatives
Similar projects and alternatives to flash-attention-minimal
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
flash-attention-minimal reviews and mentions
-
Google's First Tensor Processing Unit: Architecture
Vulcan is a driver-level API. It competes with DirectX and OpenGL.
CUDA is a language you write kernels. It competes with OpenAI's Triton language.
Here's what CUDA looks like: https://github.com/tspeterkim/flash-attention-minimal/blob/m...
This is what Triton looks like: https://triton-lang.org/main/getting-started/tutorials/06-fu...
By contrast Vulcan looks like this: https://github.com/KhronosGroup/Vulkan-Samples/blob/main/sam...
(It's true to some extent that maybe you could use Vulcan shaders to write deep learning kernels, maybe? I'm not aware of anyone doing it though)
- Show HN: Flash Attention in ~100 lines of CUDA
Stats
tspeterkim/flash-attention-minimal is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of flash-attention-minimal is Cuda.
Sponsored