Nanoflow

A throughput-oriented high-performance serving framework for LLMs (by efeslab)
Review Cuda Inference llama2 LLM llm-serving model-serving
Source Code
arxiv.org
Suggest alternative
Edit details
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
sponsored

Nanoflow Alternatives

Similar projects and alternatives to Nanoflow

efeslab
Nanoflow

  1. aici

    9 Nanoflow VS aici

    AICI: Prompts as (Wasm) Programs

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. JetStream

    2 Nanoflow VS JetStream

    JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). (by AI-Hypercomputer)

  4. SageAttention

    1 Nanoflow VS SageAttention

    [ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

  5. SpargeAttn

    1 Nanoflow VS SpargeAttn

    [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

  6. NATTEN

    1 Nanoflow VS NATTEN

    Fast Multi-dimensional Sparse Attention

  7. jetstream-pytorch

    1 Nanoflow VS jetstream-pytorch

    Discontinued PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

  8. CudaSHA256

    1 Nanoflow VS CudaSHA256

    Simple tool to calculate sha256 on GPU using Cuda

  9. simpleGEMM

    1 Nanoflow VS simpleGEMM

    The simplest but fast implementation of matrix multiplication in CUDA.

  10. vllm

    106 Nanoflow VS vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

  11. OpenLLM

    29 Nanoflow VS OpenLLM

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Nanoflow alternative or higher similarity.
Suggest an alternative to Nanoflow

Nanoflow discussion

Log in or Post with

Nanoflow reviews and mentions

Posts with mentions or reviews of Nanoflow. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic Nanoflow repo stats
1
974
9.1
5 months ago

efeslab/Nanoflow is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of Nanoflow is Jupyter Notebook.

Popular Comparisons

  1. Nanoflow VS aici
  2. Nanoflow VS JetStream
  3. Nanoflow VS SageAttention
  4. Nanoflow VS SpargeAttn
  5. Nanoflow VS NATTEN
  6. Nanoflow VS jetstream-pytorch
  7. Nanoflow VS CudaSHA256
  8. Nanoflow VS simpleGEMM
  9. Nanoflow VS vllm
  10. Nanoflow VS OpenLLM

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Jupyter Notebook is
the 15th most popular programming language
based on number of references?

Loading...