Rust rag

Open-source Rust projects categorized as rag
Edit details
Rust LLM AI Embeddings vector-database
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 23 Rust rag Projects

Rust logo
rag

  1. memvid

    Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

    Project mention: Show HN: I accidentally built "SQLite for AI memory" (Memvid) | news.ycombinator.com | 2026-01-05

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. cocoindex

    Incremental engine for long horizon agents 🌟 Star if you like it!

    Project mention: CocoIndex Review: Incremental RAG Engine for AI Agents | dev.to | 2026-05-12

  4. aichat

    All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

    Project mention: AIChat: All-in-One LLM CLI Tool | news.ycombinator.com | 2025-12-27

  5. xberg

    A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured information from PDFs, Office documents, images, and 97+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, R, C, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server.

    Project mention: Qwen3.8 is launching and going open-weight soon | news.ycombinator.com | 2026-07-20

    An alternative to Docling is Xberg: https://github.com/xberg-io/xberg

    "A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured information from PDFs, Office documents, images, and 97+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, R, C, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server."

    Amongst other things, you can use it with Open Webui: https://docs.xberg.io/integrations/openwebui/#choosing-an-en...

    fyi, they are releasing their v1.0.0 release shortly and until then you will need to a release candidate docker image tag: https://github.com/xberg-io/xberg/issues/1192

    As a layman, I would say Xberg is better than Docling because its one engine for everything while the former feels like a bunch of scripts and glue logic.

  6. postgresml

    Postgres with GPUs for ML/AI apps.

  7. helix-db

    HelixDB is an OLTP graph-vector database built in Rust on Object Storage.

    Project mention: Show HN: HelixDB – A Graph Database built on Object-storage | news.ycombinator.com | 2026-06-10

  8. trieve

    All-in-one platform for search, recommendations, RAG, and analytics offered via API

    Project mention: Ask HN: Looking for Headless CMS Recommendation | news.ycombinator.com | 2025-09-03

  9. extractous

    Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

    Project mention: Show HN: Vectorless RAG | news.ycombinator.com | 2025-08-27

    I will try it out. Is this the correct library? - https://github.com/yobix-ai/extractous

    I have used Gemini for OCR and it was indeed good. I also used GPT 3.5 and liked that too.

  10. korvus

    Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

  11. EmbedAnything

    Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

  12. fastembed-rs

    Rust library for generating vector embeddings, reranking locally!

    Project mention: Show HN: Fastembed-rs – Rust library for generating vector embeddings, reranking | news.ycombinator.com | 2026-06-15

  13. pdf_oxide

    The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.

    Project mention: PDF Oxide – Fast PDF library in Rust with Python bindings – 0.8ms,100% pass rate | news.ycombinator.com | 2026-02-24

  14. pg_vectorize

    Full-text and semantic search on any Postgres

  15. swiftide

    Fast, streaming indexing, query, and agentic LLM applications in Rust

    Project mention: Announcing Swiftide 0.31 | dev.to | 2025-09-16

    Full write up on all the things in this release at our blog and on github.

  16. ai00_server

    The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.

  17. octocode

    Semantic code searcher and codebase utility (by Muvon)

    Project mention: Ask HN: How do you give AI agents real codebase context without burning tokens? | news.ycombinator.com | 2026-03-05

    Working on a large Rust codebase. The token problem is real — Claude Code will happily spend $5 of context just trying to understand how two modules relate before writing a single line. And once context compaction kicks in, it's even worse — the agent loses the thread completely and starts grepping the same files again from scratch.

    Approaches I've tried:

    Feeding CLAUDE.md / architecture docs manually — helps, but gets stale fast. Cursor's built-in indexing — breaks on monorepos, and I don't love proprietary code going to their servers. Basic MCP server with grep — works for exact matches, useless for semantic queries.

    Eventually built something more serious: a local Tree-sitter indexer that builds a knowledge graph of file relationships and exposes it via MCP so agents query semantically instead of grepping blind. One tool call instead of 15 grep iterations. Published it here: https://github.com/Muvon/octocode

    But genuinely curious what others are doing before I go deeper on it.

    Three specific questions:

    1. How do you handle the "ripple effect" problem — knowing that changing one file semantically affects others that aren't obviously linked?

    2. Do you trust closed-source indexing with proprietary code, or have you gone local-first?

    3. Has anyone gotten GraphRAG-style relationship mapping to work in practice at scale, or is it still mostly hype?

  18. RustyRAG

    Production-grade RAG API built in Rust. Hybrid search with HNSW dense vectors and BM25 sparse matching, cross-encoder reranking, layout-aware document extraction via Docling, and 94.5% accuracy on Open RAG Bench. Powered by Cerebras, Groq, Milvus, and Jina AI.

    Project mention: Show HN: RustyRAG lowest-latency open-source RAG on GitHub | news.ycombinator.com | 2026-03-04

  19. ratel

    Context engineering for AI agents. ~80% fewer tokens. Fix tool overload. Skills and memory with in-process BM25 and semantic retrieval. Progressive Disclosure. No vector DB. (by ratel-ai)

    Project mention: Show HN: Ratel, give agents unlimited tools and skills without context bloat | news.ycombinator.com | 2026-07-16

  20. nodedb

    The memory & storage engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible.

    Project mention: Show HN: NodeDB – High Perfomance Multi-Model Database | news.ycombinator.com | 2026-05-11

  21. generalbots

    Complete open-source AI collaboration suite and multi-agent platform featuring LLM orchestration, automation, and virtual assistants. Scales seamlessly from small deployments to large enterprise environments.

  22. memex

    Fast transcript search for humans & agents. Supports Claude Code, Codex CLI & OpenCode (by nicosuave)

    Project mention: Show HN: Memex, a CLI and TUI to Search Claude Code and Codex CLI Transcripts | news.ycombinator.com | 2026-01-05

  23. VelesDB

    The explainable, local-first memory engine for AI agents. One ~9 MB binary fuses vector + graph + columnar under VelesQL; why() returns the evidence path behind every recall. No cloud, no glue code — runs on server, browser, mobile and desktop.

    Project mention: VelesDB now has a Haystack connector - build a RAG pipeline with zero infrastructure | dev.to | 2026-05-01

    VelesDB now ships a first-party Haystack 2.x DocumentStore, contributed by @CrepuscularIRIS in PR #672. Two pip installs, zero infrastructure, and your Haystack pipeline has a vector backend that runs in-process.

  24. basemind

    Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent comms, web crawl, git history + blame. 300+ languages, 10+ agent harnesses, pure Rust.

    Project mention: Debugging basemind with Claude Code | dev.to | 2026-07-08

    The method I kept coming back to: verify the artifact, watch the live system, measure the change over time, isolate the confound, read for the mechanism, and prove the fix by the number you started from. basemind lives at github.com/Goldziher/basemind.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust rag discussion

Log in or Post with

Rust rag related posts

Index

What are some of the best open-source rag projects in Rust? This list will help you:

# Project Stars
1 memvid 15,975
2 cocoindex 10,904
3 aichat 10,246
4 xberg 8,655
5 postgresml 6,807
6 helix-db 5,634
7 trieve 2,696
8 extractous 1,756
9 korvus 1,461
10 EmbedAnything 1,283
11 fastembed-rs 963
12 pdf_oxide 889
13 pg_vectorize 832
14 swiftide 719
15 ai00_server 619
16 octocode 433
17 RustyRAG 198
18 ratel 188
19 nodedb 175
20 generalbots 82
21 memex 78
22 VelesDB 75
23 basemind 67

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...