llmux

A lightweight Rust binary that sits between your code and every LLM API — failover, caching, rate limiting, cost tracking (by LakshmiSravyaVedantham)

Llmux Alternatives

Similar projects and alternatives to llmux

  1. llmtrace

    1 llmux VS llmtrace

    Zero-code LLM security & observability proxy. Real-time prompt injection detection, PII scanning, and cost control for OpenAI-compatible APIs. Built in Rust.

  2. AppSignal

    Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

    AppSignal logo
  3. llm-lens

    A flight recorder for AI agents — replay every LLM call step-by-step to find where things went wrong

  4. liter-llm

    Universal LLM API client — 163 providers, 14 native language bindings, powered by a Rust core

  5. orellius-dome

    Discontinued Protective Dome for AI Agents — MCP security gateway proxy (Rust) [GET https://api.github.com/repos/OrelliusAI/orellius-dome: 404 - Not Found // See: https://docs.github.com/rest/repos/repos#get-a-repository]

  6. llm-guard

    A configurable safety proxy for AI agents — blocks loops, cost overruns, data leaks, and error spirals (by LakshmiSravyaVedantham)

  7. usage-gate

    Usage-aware, multi-tenant API gateway built in Rust UsageGate is a lightweight developer-focused API gateway

  8. signway

    Bring the power of pre-signed URLs to your apps. Signway is a gateway for redirecting ephimeral signed URLs to the requested API

  9. Kargo

    Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.

    Kargo logo
  10. tensorzero

    10 llmux VS tensorzero

    Discontinued TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

  11. vllora

    4 llmux VS vllora

    Debug your AI agents

  12. cai

    3 llmux VS cai

    User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results! (by ad-si)

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better llmux alternative or higher similarity.

llmux discussion

Log in or Post with

llmux reviews and mentions

Posts with mentions or reviews of llmux. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2026-03-06.

Stats

Basic llmux repo stats
2
1
6.4
6 months ago

LakshmiSravyaVedantham/llmux is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of llmux is Rust.


Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com

Did you know that Rust is
the 3rd most popular programming language
based on number of references?