Rust NLP

Open-source Rust projects categorized as NLP

Top 23 Rust NLP Projects

  1. memvid

    Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

    Project mention: Show HN: I accidentally built "SQLite for AI memory" (Memvid) | news.ycombinator.com | 2026-01-05
  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. tokenizers

    ๐Ÿ’ฅ Fast State-of-the-Art Tokenizers optimized for Research and Production

    Project mention: Building Sentence Transformers in Rust: A Practical Guide with Burn, ONNX Runtime, and Candle | dev.to | 2025-10-30

    HuggingFace Tokenizers: https://huggingface.co/docs/tokenizers

  4. rust-bert

    Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

    Project mention: Building Sentence Transformers in Rust: A Practical Guide with Burn, ONNX Runtime, and Candle | dev.to | 2025-10-30

    rust-bert: Complete NLP pipelines (https://github.com/guillaume-be/rust-bert)

  5. extractous

    Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

    Project mention: Show HN: Vectorless RAG | news.ycombinator.com | 2025-08-27

    I will try it out. Is this the correct library? - https://github.com/yobix-ai/extractous

    I have used Gemini for OCR and it was indeed good. I also used GPT 3.5 and liked that too.

  6. lingua-rs

    The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

  7. whatlang-rs

    Natural language detection library for Rust. Try demo online: https://whatlang.org/

  8. nlprule

    A fast, low-resource Natural Language Processing and Text Correction library written in Rust.

  9. cargo-spellcheck

    Checks all your documentation for spelling and grammar mistakes with hunspell and a nlprule based checker for grammar

  10. model2vec-rs

    Official Rust Implementation of Model2Vec

  11. gline-rs

    Inference engine for GLiNER models, in Rust

    Project mention: GLiNER2: Unified Schema-Based Information Extraction | news.ycombinator.com | 2026-03-05

    GLiNER is a really great research work. But putting this kind of things in production is just another job. Not trying to do self promotion here, but there are alternatives for this purpose, like gline-rs (https://github.com/fbilhaut/gline-rs). Support of GLiNER 2 models is on the way.

  12. rllm

    Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating. (by graniet)

  13. vidyut

    Reliable infrastructure for Sanskrit software.

  14. txtai.rs

    Rust client for txtai

    Project mention: Agent Tools | dev.to | 2026-03-16
  15. bin2ml

    A command line tool for extracting machine learning ready data from software binaries powered by Radare2

  16. treebender

    A HDPSG-inspired symbolic natural language parser written in Rust

  17. doc2dataset

    3DCF / doc2dataset: token-efficient document layer with NumGuard numeric integrity and multi-framework exports for RAG & fine-tuning.

    Project mention: I Built an Open-Source Pipeline to Convert Documents into LLM Training Data | dev.to | 2025-12-07

    See the GitHub repo link

  18. llm_utils

    llm_utils: Basic LLM tools, best practices, and minimal abstraction.

  19. rs-trafilatura

    Fast, accurate web content extraction in Rust. ML page-type classification, per-type extraction, confidence scoring. F1=0.966 on ScrapingHub (#1), F1=0.859 across 2,008 annotated pages (1,497 development + 511 held-out test

    Project mention: How to Use rs-trafilatura with Firecrawl | dev.to | 2026-04-03

    Rust crate: crates.io/crates/rs-trafilatura ยท GitHub

  20. yozuk

    Chatbot for Programmers

  21. keyword-extraction-rs

    Keyword extraction algorithms in Rust

  22. kjarni

    Native and Private ML inference engine, embeddings, classification, reranking, search, and text generation. Rust core with C# bindings. No Python, no ONNX, no CUDA.

    Project mention: Build a Document Search Engine in C# Without Python | dev.to | 2026-02-15

    NuGet: https://www.nuget.org/packages/Kjarni GitHub: https://github.com/olafurjohannsson/kjarni

  23. Every-Other-Token

    A real-time LLM stream interceptor for token-level interaction research

  24. pg-kazsearch

    Kazakh full-text search extension for PostgreSQL

    Project mention: Show HN: Pg_kazsearch โ€“ Full-text search for Kazakh in PostgreSQL | news.ycombinator.com | 2026-04-06
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust NLP discussion

Log in or Post with

Rust NLP related posts

  • Show HN: I deleted all my note apps and built an 8MB replacement

    1 project | news.ycombinator.com | 9 Feb 2026
  • Building Sentence Transformers in Rust: A Practical Guide with Burn, ONNX Runtime, and Candle

    5 projects | dev.to | 30 Oct 2025
  • Rust-bert: Rust native ready-to-use NLP pipelines and transformer-based models

    1 project | news.ycombinator.com | 23 Sep 2025
  • Getting AI to write good SQL: Text-to-SQL techniques explained

    5 projects | news.ycombinator.com | 16 May 2025
  • Rust Keyword Extraction: Creating the YAKE! algorithm from scratch

    2 projects | dev.to | 27 Apr 2024
  • A Paninian [Sanskrit] word generator

    1 project | news.ycombinator.com | 1 Dec 2023
  • Vale.sh โ€“ A Linter for Prose

    7 projects | news.ycombinator.com | 3 Sep 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 20 Jul 2026
    SaaSHub helps you find the best software and product alternatives Learn more โ†’

Index

What are some of the best open-source NLP projects in Rust? This list will help you:

# Project Stars
1 memvid 15,975
2 tokenizers 10,892
3 rust-bert 3,073
4 extractous 1,756
5 lingua-rs 1,106
6 whatlang-rs 1,084
7 nlprule 662
8 cargo-spellcheck 360
9 model2vec-rs 197
10 gline-rs 155
11 rllm 139
12 vidyut 121
13 txtai.rs 113
14 bin2ml 74
15 treebender 62
16 doc2dataset 57
17 llm_utils 47
18 rs-trafilatura 42
19 yozuk 39
20 keyword-extraction-rs 33
21 kjarni 33
22 Every-Other-Token 25
23 pg-kazsearch 24

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com