Top 8 Rust langchain Projects
-
llm-chain
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
-
AppSignal
AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
-
-
Project mention: Show HN: Ask your LLM traces what went wrong (vLLora) | news.ycombinator.com | 2026-01-26
Hi HN,
We built Lucy, a trace-debugging tool inside vLLora (our open-source LLM observability stack).
The problem: Debugging AI agents is painful. A single failure often hides inside a trace with 200+ spans—tool calls, retries, partial outputs, and silent failures. Even with tracing, finding the actual root cause (e.g. a tool schema mismatch or a contradictory system prompt) usually means manually scanning logs for 20+ minutes.
What Lucy does: Lucy lets you query your traces using natural language. You can ask things like “Why did this agent loop?” or “Which step was slow?” and it inspects the span tree to surface likely causes. For example, it can flag:
- Tool schema mismatches (e.g. hallucinated or invalid arguments)
- Prompt contradictions (e.g. system instruction conflicts with user intent)
- Silent failures (e.g. context truncation or max-token exits)
It’s early and still in beta.
We’d love to hear how you’re debugging agent failures today—logs, replay, evals, custom scripts, or something else.
Link to Repo: https://github.com/vllora/vllora
-
tenuo
Task-scoped authorization for AI agents. Cryptographic warrants constrain tools and arguments, prevent privilege escalation at every delegation hop, and produce signed evidence of what was allowed or denied.
Building tenuo.ai (https://github.com/tenuo-ai/tenuo): task-scoped authorization for AI agents. Rust implementation of capabilities + cryptographic offline verification.
-
RAG-Enterprise
🚀 100% local RAG system with one-command setup. Your data never leaves your server. Apache-2.0
Project mention: Show HN: RAG-Enterprise – 100% local RAG system for enterprise documents | news.ycombinator.com | 2026-03-01License is AGPL-3.0. I get it, some orgs see that and nope out – if it gets traction maybe dual-license down the line.
Repo, docs and a quick GIF in the README: https://github.com/I3K-IT/RAG-Enterprise
Would love real feedback, the honest/rude kind especially:
Setup blow up on your rig? -
agentshield
🛡️ The security firewall for AI agent tools & MCP servers (Claude, GPT-5.6, Gemini 3.7, Antigravity, Cursor, Codex, Hermes). Catch command injection, secret theft & toxic flows in <50ms. 100% offline Rust SAST + 1-click auto-fix + SARIF. (by aiconnai)
Project mention: AgentShield – Offline Rust security scanner for AI agent tools and MCP (<50ms) | news.ycombinator.com | 2026-08-16 -
langchainrust
A Rust framework for building LLM applications with support for 8+ LLM providers, agents, RAG, BM25/hybrid search, LangGraph workflows, and multiple vector/document storage backends.
Project mention: langchain-rust: Build LLM apps with Ollama + local models in pure Rust — no Python needed | dev.to | 2026-08-03If you're running local models through Ollama and tired of Python's overhead, check out langchain-rust.
-
Kargo
Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
-
mentedb
A cognition aware database engine for AI agent memory. Purpose built in Rust with WAL, HNSW, knowledge graphs, and speculative context pre assembly. Not a wrapper, a ground up storage engine that thinks.
The engine call is recall_for_action in mentedb 0.27.2, the hosted API exposes it as the get_action_rules tool, and npx mentedb-mcp@latest setup installs the hook. Tag a commit rule, ask for a commit, and watch it show up at exactly the right moment. The live demo at demo.mentedb.com has the rest of the memory graph to explore.
Rust langchain discussion
Rust langchain related posts
Index
What are some of the best open-source langchain projects in Rust? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | llm-chain | 1,605 |
| 2 | langchain-rust | 1,343 |
| 3 | vllora | 812 |
| 4 | tenuo | 89 |
| 5 | RAG-Enterprise | 57 |
| 6 | agentshield | 18 |
| 7 | langchainrust | 14 |
| 8 | mentedb | 3 |