Rust AI

Open-source Rust projects categorized as AI

Top 23 Rust AI Projects

  1. MeiliSearch

    A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.

    Project mention: Hister – private, self hosted search engine | news.ycombinator.com | 2026-08-18

    > Would Hister be suitable for this?

    The indexer it uses (Bleve) can handle millions of records according to their docs, but sure that Hister would be the best choice for this task. I'd probably use Meilisearch (https://www.meilisearch.com/).

    > Can it index mbox files?

    Not yet.

    > Does it have a search API so I can build an MCP server?

    It has both search API and MCP server endpoints.

  2. AppSignal

    AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.

    AppSignal logo
  3. ChatGPT

    ❄️ ChatGPT Desktop Application (Mac, Windows and Linux)

    Project mention: ChatGPT VS BotVa - a user suggested alternative | libhunt.com/r/ChatGPT | 2026-03-23
  4. herdr

    the runtime your coding agents live on

    Project mention: Making Ghostty and herdr share one keyboard | dev.to | 2026-08-30

    I've been on Ghostty for about 8 months. Last week I added herdr, a multiplexer built around running coding agents (Claude Code, Codex, opencode and friends) in panes. Ghostty already has tabs and splits, with Cmd shortcuts I use all day. herdr has its own tabs, panes and workspaces, with its own keys.

  5. tabby

    Self-hosted AI coding assistant

    Project mention: Tabby Review 2026: Self-Hosted Code Completion for Teams | dev.to | 2026-06-01

    Tabby (by TabbyML) is a self-hosted AI coding assistant built in Rust, licensed under Apache 2.0, and available at github.com/TabbyML/tabby with around 33,000 GitHub stars as of mid-2026. The latest stable release is v0.32.0 (January 25, 2026), which added Mistral Embedding API support, generic OAuth, and multi-branch repository indexing.

  6. meetily

    Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

    Project mention: Yap – free offline voice dictation for Mac/Windows/Linux (Wispr Flow alt) | news.ycombinator.com | 2026-06-27

    I actually found this one today and will be adding it to Opensource Builders soon:

    https://github.com/Zackriya-Solutions/meetily

  7. chroma

    Search infrastructure for AI

    Project mention: chroma VS verified-memory-vault - a user suggested alternative | libhunt.com/r/chroma | 2026-08-25
  8. screenpipe

    YC (S26) | Open Computer History | Record your screen continuously locally and provide context to your agents (Claude, Codex, Openclaw, Hermes, Runner...)

    Project mention: Launch HN: Screenpipe (YC S26) – Power your agents by your 24/7 screen recording | news.ycombinator.com | 2026-07-23

    Warning: this link automatically downloads a .dmg file without asking.

    https://screenpipe.com /how-to-install

  9. Kargo

    Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.

    Kargo logo
  10. cube.js

    📊 Cube Core is open-source semantic layer for AI, BI and embedded analytics

    Project mention: An Agent's Field Guide to Semantic Layers | dev.to | 2026-08-26

    The incumbents in the semantic layer space are MetricFlow (dbt’s semantic layer engine) and Cube.js; worth mentioning is Lightdash, which used to be more of a dashboard solution but is now increasingly beefing up its semantic layer side. A project to watch is Apache Ossie (formerly Open Semantic Interchange), which aims to become an open source semantic layer standard. At the moment it only has a limited spec for specifying datasets and no reference semantics for querying, so definitely worth following but not a full solution at the moment. Finally, we will cover SLayer, a recent entrant aiming to be used by agents as well as humans.

  11. iii

    Effortlessly compose, extend, and observe every service in real-time for the first time ever.

    Project mention: Motia: Unified back end framework with observability and state management | news.ycombinator.com | 2026-02-08
  12. memvid

    Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

    Project mention: memvid VS verified-memory-vault - a user suggested alternative | libhunt.com/r/memvid | 2026-08-26
  13. cocoindex

    Incremental engine for long horizon agents 🌟 Star if you like it!

    Project mention: CocoIndex Review: Incremental RAG Engine for AI Agents | dev.to | 2026-05-12
  14. aichat

    All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

    Project mention: AIChat: All-in-One LLM CLI Tool | news.ycombinator.com | 2025-12-27
  15. databend

    Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.

  16. rig

    ⚙️🦀 Build modular and scalable LLM Applications in Rust

    Project mention: Rig – Agentic Workflows in Rust | news.ycombinator.com | 2026-08-29
  17. microsandbox

    🧱 easy fast local-first microVM runtime and library

    Project mention: Docker Sandboxes – Disposable, isolated sandboxes for AI agents | news.ycombinator.com | 2026-08-09

    it's been mentioned on this thread already, we think https://github.com/superradcompany/microsandbox/ is the closest OSS to it and we have a great DX and improving.

  18. code2prompt

    A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

    Project mention: Code2prompt: Convert any folder into a single LLM prompt | news.ycombinator.com | 2026-05-28
  19. postgresml

    Postgres with GPUs for ML/AI apps.

    Project mention: PostgreSQL for Everything | news.ycombinator.com | 2026-08-19

    One addition: Postgres for all your GPU-based machine learning training and inference needs: https://github.com/postgresml/postgresml

  20. helix-db

    HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.

    Project mention: Show HN: HelixDB – A Graph Database built on Object-storage | news.ycombinator.com | 2026-06-10
  21. deepreasoning

    A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

  22. text-embeddings-inference

    A blazing fast inference solution for text embeddings models

    Project mention: Cut token waste across your entire team with the MCP Optimizer | dev.to | 2026-03-11

    The operator defaults to BAAI/bge-small-en-v1.5 as the model and runs the HuggingFace Text Embeddings Inference server. You can increase the replica count via spec.replicas to match your team's throughput needs. One shared instance serves every vMCP in the namespace. For all available configuration options, see the Optimizer docs.

  23. agentgateway

    Next Generation Agentic Proxy for AI Agents and MCP servers

    Project mention: MCP new specs in Practice: Testing the Stateless Revolution on AWS AgentCore Gateway | dev.to | 2026-08-01

    AAIF's agentgateway is the open-source counterpart to managed gateways like AgentCore. My next post will compare how agentgateway v1.3 and AgentCore Gateway each handle MCP 7-28 -- same protocol, different deployment models, different tradeoffs.

  24. RuVector

    RuVector is a High Performance, Real-Time, Self-Learning Ai, Vector GNN, Memory DB built in Rust.

    Project mention: High Performance, Real-Time, Self-Learning, Vector GNN and DB Built in Rust | news.ycombinator.com | 2026-02-26
  25. agentos

    Give agents an operating system as a library. Runs in your existing backend – no sandboxes, VMs, or SaaS. Powered by WebAssembly & V8 isolates. (by rivet-dev)

    Project mention: Your Agent Bills While It Waits. Here's the Fix. | dev.to | 2026-07-18

    Their companion project AgentOS runs coding agents inside isolated Linux VMs with an in-process operating system kernel. Everything runs inside the kernel; nothing executes on the host. The pitch: faster, lighter, cheaper than mainstream sandbox providers.

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust AI discussion

Log in or Post with

Rust AI related posts

Index

What are some of the best open-source AI projects in Rust? This list will help you:

# Project Stars
1 MeiliSearch 59,174
2 ChatGPT 54,462
3 herdr 35,017
4 tabby 33,859
5 meetily 30,388
6 chroma 29,222
7 screenpipe 21,437
8 cube.js 20,779
9 iii 18,672
10 memvid 16,481
11 cocoindex 11,493
12 aichat 10,423
13 databend 9,434
14 rig 8,508
15 microsandbox 8,090
16 code2prompt 7,622
17 postgresml 6,807
18 helix-db 5,885
19 deepreasoning 5,364
20 text-embeddings-inference 5,036
21 agentgateway 4,725
22 RuVector 4,474
23 agentos 4,470

Sponsored
AppSignal knows why the f*#k it crashed.
Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
www.appsignal.com