nano-vllm

Nano vLLM (by GeeeekExplorer)

Nano-vllm Alternatives

Similar projects and alternatives to nano-vllm

  1. transformers

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. vllm

    50 nano-vllm VS vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

  4. tt-metal

    :metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

  5. ik_llama.cpp

    llama.cpp fork with additional SOTA quants and improved performance

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better nano-vllm alternative or higher similarity.

nano-vllm discussion

Log in or Post with

nano-vllm reviews and mentions

Posts with mentions or reviews of nano-vllm. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2025-06-24.

Stats

Basic nano-vllm repo stats
5
5,188
7.2
17 days ago

GeeeekExplorer/nano-vllm is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of nano-vllm is Python.


Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?