Rust ollama

Open-source Rust projects categorized as ollama
Rust LLM AI CLI local-ai

Top 23 Rust ollama Projects

  1. meetily

    Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

    Project mention: Yap – free offline voice dictation for Mac/Windows/Linux (Wispr Flow alt) | news.ycombinator.com | 2026-06-27

    I actually found this one today and will be adding it to Opensource Builders soon:

    https://github.com/Zackriya-Solutions/meetily

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. aichat

    All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

    Project mention: AIChat: All-in-One LLM CLI Tool | news.ycombinator.com | 2025-12-27
  4. tenere

    🤖 TUI for LLMs

  5. plock

    From anywhere you can type, query and stream the output of any script (e.g. an LLM)

    Project mention: Show HN: Yoink AI – macOS AI app that edits directly in any textfield of any app | news.ycombinator.com | 2025-08-28

    Can't speak to Yoink but I built a project that did something similar. I used a stupid simple method - input simulation. And if you want context, you can simulate select all / copy. Similar if you want to replace, etc.

    https://github.com/jasonjmcghee/plock

  6. xybrid

    Build apps powered by on-device AI

    Project mention: Run AI Models On-Device — Zero Config, Five Minutes | dev.to | 2026-04-06

    Now you want to actually do it. Here's what that looks like with Xybrid — no tensor shapes, no preprocessing scripts, no ML expertise.

  7. cai

    User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results! (by ad-si)

    Project mention: Show HN: Cai – CLI tool for AI tasks | news.ycombinator.com | 2026-01-28
  8. claudectl

    Auto pilot for Claude Code - connect multiple coding agents to a local LLM brain. 🆕 with a hive mind now

    Project mention: Local AI needs to be the norm | news.ycombinator.com | 2026-05-10
  9. rllm

    Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating. (by graniet)

  10. ollamaMQ

    High-performance Ollama & LM Studio proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

    Project mention: OllamaMQ New Version v0.2.7 | news.ycombinator.com | 2026-05-31
  11. hoof

    "Just hoof it!" - A spotlight like interface to Ollama

  12. wshm

    AI-powered repository agent for GitHub, GitLab, Gitea, Azure DevOps. Issue triage, PR analysis, merge queue, notifications, dashboard, backup. Self-hosted, multi-provider.

    Project mention: Show HN: EmergingRepos – finding repos that are just starting to get momentum | news.ycombinator.com | 2026-05-04
  13. vox

    Local voice AI framework for Rust. Whisper + LLM + TTS with no cloud dependencies. (by mrtozner)

    Project mention: Vox – Local Voice AI Framework in Rust (STT and TTS and VAD) | news.ycombinator.com | 2026-02-15
  14. Elpis

    You put an agent into an Elpis, and it becomes Elpis; Be Elpis my friend.

    Project mention: 🏰 A-Modular-Kingdom: The Foundation for AI-Powered Multi-Agent Systems | dev.to | 2025-11-06

    # Clone the repository git clone https://github.com/MasihMoafi/A-Modular-Kingdom.git cd A-Modular-Kingdom # Install dependencies uv sync # Or with pip pip install -r requirements.txt # Start the MCP server python agent/host.py # In another terminal, start the interactive client python agent/main.py

  15. nika

    Intent as Code | the workflow language for AI. One file, 4 verbs, one Rust binary. Local-first, any model, AGPL-3.0. 🦋

    Project mention: Nika – Intent as Code for AI Workflows | news.ycombinator.com | 2026-07-08
  16. gn

    Pull 90-day news snapshots.

    Project mention: Show HN: Gn – gets, filters, and labels news on the command-line | news.ycombinator.com | 2026-06-19
  17. messy-folder-reorganizer-ai

    🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.

  18. zenii

    Your machine's AI brain. One 20MB binary gives every tool, script, and cron job shared AI memory + 133 API routes. Desktop app, CLI, Telegram — all connected. Rust-powered.

    Project mention: Your Cron Jobs Can't Think. These Can. | dev.to | 2026-05-08

    I automated the entire thing — including the LLM call — in one TOML file. No Python. No Bash glue. No three separate cron entries. Zenii runs the whole pipeline on a schedule, passes outputs between steps, and fires off the Telegram message before I've poured my first coffee.

  19. garudust-agent

    🦅 Open-source self-improving AI agent in Rust — persistent memory, skill learning, tool hub, multi-platform bots & production gateway

    Project mention: ตรวจจับ Log Anomaly อัตโนมัติด้วย Garudust Agent 🦅 | dev.to | 2026-05-18

    Garudust Agent

  20. ares

    Agentic AI server in Rust. Multi-provider LLM routing, tool calling, RAG, MCP, multi-tenant workflows. (by dirmacs)

    Project mention: Building AI Infrastructure for a Post-Framework World | dev.to | 2026-01-13

    Repository: ares

  21. HashMeterAi

    The honest, local-first usage meter for AI coding tools. With full privacy and with no server or reading your chats.

    Project mention: Show HN: HashMeterAi – Private AI Token Real Usage Meter for All Models | news.ycombinator.com | 2026-06-15
  22. ryvos

    Open-source autonomous AI assistant with 5-tier security, 62 tools, 14 LLM providers. Written in Rust. Single binary.

    Project mention: Show HN: Ryvos – Autonomous AI assistant in Rust(15MB RAM,50 tools,16 providers) | news.ycombinator.com | 2026-02-26

    hit security or performance walls.

    GitHub: https://github.com/Ryvos/ryvos

  23. comp-scan

    A fully local AI agent that scans your system, observes usage patterns, and suggests one-click improvements. Rust • private • zero telemetry.

    Project mention: Show HN: CompScan, a local system health doctor (Rust, no telemetry) | news.ycombinator.com | 2026-03-05
  24. Commitgenius

    A Rust-based CLI tool that uses local LLMs (via Ollama) to generate conventional commit messages from your git diffs. (by bannawandoor27)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust ollama discussion

Log in or Post with

Rust ollama related posts

  • Introducing LlamaStash: a zero-overhead, terminal-native llama.cpp launcher

    15 projects | dev.to | 2 Jun 2026
  • OllamaMQ New Version v0.2.7

    1 project | news.ycombinator.com | 31 May 2026
  • Your Cron Jobs Can't Think. These Can.

    1 project | dev.to | 8 May 2026
  • Stop Rereading Your Documents. Let the AI Study Them Once.

    1 project | dev.to | 7 May 2026
  • New OllamaMQ Version v0.2.5

    1 project | news.ycombinator.com | 22 Mar 2026
  • AIChat: All-in-One LLM CLI Tool

    1 project | news.ycombinator.com | 27 Dec 2025
  • Show HN: Yoink AI – macOS AI app that edits directly in any textfield of any app

    1 project | news.ycombinator.com | 28 Aug 2025
  • A note from our sponsor - SaaSHub
    www.saashub.com | 20 Jul 2026
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source ollama projects in Rust? This list will help you:

# Project Stars
1 meetily 25,407
2 aichat 10,246
3 tenere 675
4 plock 504
5 xybrid 297
6 cai 203
7 claudectl 148
8 rllm 139
9 ollamaMQ 112
10 hoof 63
11 wshm 39
12 vox 36
13 Elpis 30
14 nika 29
15 gn 22
16 messy-folder-reorganizer-ai 20
17 zenii 19
18 garudust-agent 18
19 ares 16
20 HashMeterAi 14
21 ryvos 7
22 comp-scan 7
23 Commitgenius 7

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com