Rust llama

Open-source Rust projects categorized as llama
Edit details
LLM Rust AI openai mistral
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 10 Rust llama Projects

Rust logo
llama

  1. lsp-ai

    LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. kalosm

    Instant, controllable, local pre-trained AI models in Rust

  4. llm-chain

    `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

  5. fltr

    Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

  6. cai

    User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results! (by ad-si)

    Project mention: Show HN: Cai – CLI tool for AI tasks | news.ycombinator.com | 2026-01-28

  7. llama-dfdx

    LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!

  8. hoof

    "Just hoof it!" - A spotlight like interface to Ollama

  9. kjarni

    Native and Private ML inference engine, embeddings, classification, reranking, search, and text generation. Rust core with C# bindings. No Python, no ONNX, no CUDA.

    Project mention: Build a Document Search Engine in C# Without Python | dev.to | 2026-02-15

    NuGet: https://www.nuget.org/packages/Kjarni GitHub: https://github.com/olafurjohannsson/kjarni

  10. shimmytok

    Pure Rust tokenizer for GGUF models - llama.cpp compatible

    Project mention: Show HN: Shimmytok – Pure Rust GGUF tokenizer (no C++, no extra files) | news.ycombinator.com | 2026-01-13

  11. lancor

    End-to-end llama.cpp toolkit in Rust. API client, HuggingFace Hub, server orchestration.

    Project mention: Building AI Infrastructure for a Post-Framework World | dev.to | 2026-01-13
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust llama discussion

Log in or Post with

Rust llama related posts

Index

What are some of the best open-source llama projects in Rust? This list will help you:

# Project Stars
1 lsp-ai 3,188
2 kalosm 2,211
3 llm-chain 1,598
4 fltr 387
5 cai 203
6 llama-dfdx 113
7 hoof 63
8 kjarni 33
9 shimmytok 21
10 lancor 3

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...