Flash-attention Alternatives

Similar projects and alternatives to flash-attention

• memory-efficient-attention-pytorch

  1 227 6.1 Python flash-attention VS memory-efficient-attention-pytorch

  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

• kernl

  6 1,066 8.8 Jupyter Notebook flash-attention VS kernl

  Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

  

• Sonar

  www.sonarsource.com

  sponsored

  Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  

• RWKV-LM

  1 2,666 8.0 Python flash-attention VS RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

• TensorRT

  - 6,803 9.3 C++ flash-attention VS TensorRT

  NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

  

• XMem

  1 952 8.6 Python flash-attention VS XMem

  [ECCV 2022] XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model

• quality

  1 65 7.0 Python flash-attention VS quality

  

• RWKV-v2-RNN-Pile

  1 50 8.3 Python flash-attention VS RWKV-v2-RNN-Pile

  RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

• InfluxDB

  www.influxdata.com

  sponsored

  Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  

• flash-attention-jax

  1 83 8.2 Python flash-attention VS flash-attention-jax

  Implementation of Flash Attention in Jax

• google-research

  1 27,994 9.8 Jupyter Notebook flash-attention VS google-research

  Google Research

  

• whisper.cpp

  2 12,415 9.7 C flash-attention VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• diffusers

  2 12,137 9.9 Python flash-attention VS diffusers

  🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

  

• xformers

  2 3,165 10.0 Python flash-attention VS xformers

  Hackable and optimized Transformers building blocks, supporting a composable construction.

  

• stable-diffusion-webui

  1 50,546 10.0 Python flash-attention VS stable-diffusion-webui

  Stable Diffusion web UI

• whisper

  1 29,264 9.4 Python flash-attention VS whisper

  Robust Speech Recognition via Large-Scale Weak Supervision

  

• transformer-deploy

  1 1,286 6.6 Python flash-attention VS transformer-deploy

  Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

  

• EfficientZero

  1 695 2.8 Python flash-attention VS EfficientZero

  Open-source codebase for EfficientZero, from "Mastering Atari Games with Limited Data" at NeurIPS 2021.

• msn

  1 384 3.7 Python flash-attention VS msn

  Masked Siamese Networks for Label-Efficient Learning (https://arxiv.org/abs/2204.07141)

  

• CodeRL

  1 307 7.7 Python flash-attention VS CodeRL

  This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (NeurIPS22).

  

• perceiver-ar

  1 176 5.3 Python flash-attention VS perceiver-ar

  

• RHO-Loss

  1 143 5.5 Python flash-attention VS RHO-Loss

  

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives