Rust language-model

Open-source Rust projects categorized as language-model
Edit details
Rust LLM Machine Learning Deep Learning NLP
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 8 Rust language-model Projects

Rust logo
language-model

  1. tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    Project mention: Building Sentence Transformers in Rust: A Practical Guide with Burn, ONNX Runtime, and Candle | dev.to | 2025-10-30

    HuggingFace Tokenizers: https://huggingface.co/docs/tokenizers

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. GenieX

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    Project mention: Qualcomm acquires Nexa AI, open-sources GenAI runtime for Hexagon NPUs | news.ycombinator.com | 2026-07-07

  4. aici

    AICI: Prompts as (Wasm) Programs

    Project mention: MCP Doesn't Need 30 Tools: It Needs Code | news.ycombinator.com | 2025-08-18

    Oh yeah, it can certainly work, sounds like cool stuff! The question is not whether it can work, but whether it works better than an edit tool using textual search/replace blocks. Not to throw shade on the idea, there's certainly tons of variations that I'm sure haven't yet been tried.

    Yes agentic loop with diagnostic feedback is quite powerful. I'd love to have more controllable structured decode from the big llm providers to skip some sources of needing to loop - something like https://github.com/microsoft/aici

  5. Nuclia DB

    NucliaDB, The AI Search database for RAG

  6. rusty

    AI-powered CLI tool to help you remember bash commands.

  7. llama-dfdx

    LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!

  8. smolrsrwkv

    A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.

  9. bytepiece-rs

    The Bytepiece Tokenizer Implemented in Rust.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust language-model discussion

Log in or Post with

Rust language-model related posts

  • Operator: cuando responder no basta

    3 projects | dev.to | 3 Jun 2026

  • ForgeCode vs Claude Code: which AI coding agent actually wins?

    3 projects | dev.to | 9 Apr 2026

  • HF Transfer: Speed up file transfers

    2 projects | /r/rust | 7 Jul 2023

  • LLM custom dictionary

    1 project | /r/learnmachinelearning | 7 May 2023

  • Introducing repugnant-pickle, a crate for scraping Python Pickle files in a basic way. Notable, it can deal with (some) PyTorch model files.

    2 projects | /r/rust | 6 Apr 2023

  • Is GPT-4 still just a language model trying to predict text?

    1 project | /r/artificial | 5 Apr 2023

  • [D] What's going to be the dominant language for machine learning in 5 years?

    1 project | /r/MachineLearning | 9 Feb 2021
  • A note from our sponsor - SaaSHub
    www.saashub.com | 20 Jul 2026
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source language-model projects in Rust? This list will help you:

# Project Stars
1 tokenizers 10,892
2 GenieX 8,226
3 aici 2,077
4 Nuclia DB 717
5 rusty 333
6 llama-dfdx 111
7 smolrsrwkv 94
8 bytepiece-rs 14

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...