Rust llm-tools

Open-source Rust projects categorized as llm-tools

Top 11 Rust llm-tool Projects

  1. mcp-guardian

    Manage / Proxy / Secure your MCP Servers

  2. AppSignal

    Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

    AppSignal logo
  3. branchbox

    Parallel, isolated dev environments for humans and AI coding agents. Real containers. Real databases. Zero collisions.

    Project mention: Show HN: BranchBox – isolated dev environments per feature | news.ycombinator.com | 2025-11-14
  4. roberto-mcp

    Simple Code Analysis MCP server, language agnostic with code indexing and search capabilities.

  5. lain

    High-performance MCP server for AI coding agents: persistent knowledge graph, blast radius analysis, semantic search. Built in Rust. (by spuentesp)

    Project mention: Show HN: Lain, a structural code graph and agent coordinator for coding agents | news.ycombinator.com | 2026-09-20
  6. cuemap

    A deterministic, high-performance memory engine. Built in Rust.

    Project mention: Show HN: CueMap – deterministic-first memory retrieval for continuous recall | news.ycombinator.com | 2026-08-26
  7. agent-joe

    Shellless and rust only llm agent

    Project mention: AI Coding at Home Without Going Broke | news.ycombinator.com | 2026-06-13
  8. bareos-mcp-server

    MCP server for Bareos backup system. Query your backups via your favorite AI assistant

    Project mention: Building my first MCP server: teaching AI assistants about backups | dev.to | 2026-02-15

    The code is open source at https://github.com/edeckers/bareos-mcp-server with installation instructions for both Claude Code and Claude Desktop.

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. suture-stream-repair

    Ultra-low-latency reverse proxy that repairs truncated & malformed JSON in LLM streaming responses (OpenAI, Anthropic, Vertex AI, Bedrock) — fixes JSONDecodeError / serde_json EOF on truncated tool calls.

    Project mention: Show HN: Suture – a reverse proxy that repairs truncated JSON in LLM streams | news.ycombinator.com | 2026-06-03
  11. WVM

    Headless Windows 11 execution sandbox for AI agents. Typed Rust control plane over KVM/QEMU with an append-only audit journal and strict capability boundary.

    Project mention: WVM – A headless Windows 11 execution sandbox for AI agents | news.ycombinator.com | 2026-09-16
  12. BurpSqueezer

    Turn Burp Suite XML dumps into compact, LLM-ready Markdown reports.

    Project mention: I tried giving a 26 MB Burp Suite dump to an LLM. It didn't work. So I built BurpSqueezer. | dev.to | 2026-09-16

    GitHub: vaginskii/BurpSqueezer

  13. Mutagen

    Mutagen is a Rust based harness for Claude and Codex that was developed to lead users from idea to full-stack application with greater precision and less cost than competitors. (by CHKDSKLabs)

    Project mention: Mutagen 0.4.0 Released: Service Extraction, Bug Crunches, and Fixed Persona Drift | dev.to | 2026-06-03

    Mutagen 0.4.0 addresses the friction points that plague agentic workflows: context bloat, brittle persona transitions, and the lack of a deterministic path from design document to deployed artifact. We aren't trying to make prompts smarter; we are making the harness that executes them more precise. This release introduces a Rust-based service extraction layer that decouples static dependency mapping from generative reasoning, implements an adversarial verification pipeline to gate deployment, and enforces strict stage transitions to prevent the agent personas we rely on from drifting into one another's scopes.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust llm-tools discussion

Log in or Post with

Rust llm-tools related posts

  • Mutagen 0.4.0 Released: Service Extraction, Bug Crunches, and Fixed Persona Drift

    1 project | dev.to | 3 Jun 2026
  • Welcome to Mutagen

    1 project | dev.to | 1 Jun 2026

Index

What are some of the best open-source llm-tool projects in Rust? This list will help you:

# Project Stars
1 mcp-guardian 198
2 branchbox 86
3 roberto-mcp 9
4 lain 9
5 cuemap 8
6 agent-joe 6
7 bareos-mcp-server 2
8 suture-stream-repair 1
9 WVM 1
10 BurpSqueezer 0
11 Mutagen 0

Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com

Did you know that Rust is
the 3rd most popular programming language
based on number of references?