semantic-router

A programmable Mixture-of-Models router for heterogeneous LLM inference (by vllm-project)
Review bert-classification Golang huggingface-candle huggingface-transformers mixture-of-models pii-detection prompt-guard Rust semantic-router vllm ai-gateway fine-tuning Kubernetes prompt-engineering mcp llmrouter LLM openclaw
Source Code
vllm-sr.ai
Suggest alternative
Edit details
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
sponsored

Semantic-router Alternatives

Similar projects and alternatives to semantic-router

vllm-project
semantic-router

  1. RouterArena

    3 semantic-router VS RouterArena

    RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. router

    2 semantic-router VS router

    Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change. (by workweave)

  4. murmur

    4 semantic-router VS murmur

    Claude Code, Codex, Gemini all on a shared communication bus (by instavm)

  5. ai-gateway

    2 semantic-router VS ai-gateway

    Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative. (by ferro-labs)

  6. llmariner

    1 semantic-router VS llmariner

    Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

  7. goclaw

    3 semantic-router VS goclaw

    GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.

  8. voidllm

    3 semantic-router VS voidllm

    Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better semantic-router alternative or higher similarity.
Suggest an alternative to semantic-router

semantic-router discussion

Log in or Post with

semantic-router reviews and mentions

Posts with mentions or reviews of semantic-router. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2026-06-26.

Stats

Basic semantic-router repo stats
1
5,126
9.9
7 days ago

vllm-project/semantic-router is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of semantic-router is Go.

Popular Comparisons

  1. semantic-router VS RouterArena
  2. semantic-router VS ai-gateway
  3. semantic-router VS router
  4. semantic-router VS llmariner
  5. semantic-router VS goclaw
  6. semantic-router VS murmur
  7. semantic-router VS voidllm

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...