Rust Natural Language Processing

Open-source Rust projects categorized as Natural Language Processing

Top 7 Rust Natural Language Processing Projects

  • tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    Project mention: HF Transfer: Speed up file transfers | /r/rust | 2023-07-07

    Hugging Face seems to like Rust. They also wrote Tokenizers in Rust.

  • lingua-rs

    The most accurate natural language detection library for Rust, suitable for long and short text alike

    Project mention: Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text | /r/rust | 2023-06-15
  • Mergify

    Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.

  • nlprule

    A fast, low-resource Natural Language Processing and Text Correction library written in Rust.

    Project mention: – A Linter for Prose | | 2023-09-03

    Another interesting projects in the space:

    - nlprule:

    - prosemd:

    - cargo spellcheck:

  • whichlang

    A blazingly fast and lightweight language detection library for Rust

    Project mention: Show HN: Quickwit – Cost-efficient Elasticsearch alternative on object storage | | 2023-06-07

    - Another nice comment seen on HN « it seems to be very easy to run, not very IO intensive, and running fine on a single node with modest hardware with >2 billion log rows. It has a really cool dynamic schema feature too.» [9]

    Fun fact: at least 4 users are using Garage[10] as the object storage, this OSS project looks really promising and made the HN front page a few months ago[11], we really cherish the OSS for this kind of unexpected combination.

    Any feedback positive/negative always greatly appreciated here!

    [0] Quickwit repo:

    [1] Searching the web under 1000$/month:

    [2] Chitchat gossip library:

    [3] Columnar format:

    [4] Tantivy library:

    [5] Whichlang library:

    [6] GitHub Archive demo in terminal:

    [7] Indexing performance:



    [10] Garage object storage:


  • instant-segment

    Fast English word segmentation in Rust

  • dpar

    Neural network transition-based dependency parser (in Rust)

  • nlpo3

    Thai Natural Language Processing library in Rust, with Python and Node bindings.

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-03.

Rust Natural Language Processing related posts


What are some of the best open-source Natural Language Processing projects in Rust? This list will help you:

Project Stars
1 tokenizers 7,583
2 lingua-rs 724
3 nlprule 541
4 whichlang 322
5 instant-segment 75
6 dpar 41
7 nlpo3 27
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.