Rust NLP

Open-source Rust projects categorized as NLP

Top 15 Rust NLP Projects

  • tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

  • Project mention: HF Transfer: Speed up file transfers | /r/rust | 2023-07-07

    Hugging Face seems to like Rust. They also wrote Tokenizers in Rust.

  • rust-bert

    Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

  • Project mention: How to leverage the state-of-the-art NLP models in Rust | /r/infinilabs | 2023-06-07

    brew install libtorch brew link libtorch brew ls --verbose libtorch | grep dylib export LIBTORCH=$(brew --cellar pytorch)/$(brew info --json pytorch | jq -r '.[0].installed[0].version') export LD_LIBRARY_PATH=${LIBTORCH}/lib:$LD_LIBRARY_PATH git clone https://github.com/guillaume-be/rust-bert.git cd rust-bert ORT_STRATEGY=system cargo run --example sentence_embeddings

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • whatlang-rs

    Natural language detection library for Rust. Try demo online: https://whatlang.org/

  • Project mention: Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text | /r/rust | 2023-06-15

    How does it compare to whatlang?

  • lingua-rs

    The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

  • Project mention: I created a program that finds out which anki cards out of 50_000 are in english and deletes them in 2 minutes | /r/rust | 2023-10-23

    Discovery of Lingua: While working on a different project, I discovered the Lingua library.

  • nlprule

    A fast, low-resource Natural Language Processing and Text Correction library written in Rust.

  • Project mention: Vale.sh – A Linter for Prose | news.ycombinator.com | 2023-09-03

    Another interesting projects in the space:

    - nlprule: https://github.com/bminixhofer/nlprule

    - prosemd: https://github.com/kitten/prosemd-lsp

    - cargo spellcheck: https://github.com/drahnr/cargo-spellcheck

  • cargo-spellcheck

    Checks all your documentation for spelling and grammar mistakes with hunspell and a nlprule based checker for grammar

  • Project mention: Vale.sh – A Linter for Prose | news.ycombinator.com | 2023-09-03

    Another interesting projects in the space:

    - nlprule: https://github.com/bminixhofer/nlprule

    - prosemd: https://github.com/kitten/prosemd-lsp

    - cargo spellcheck: https://github.com/drahnr/cargo-spellcheck

  • txtai.rs

    Rust client for txtai

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • vidyut

    Infrastructure for Sanskrit software. For Python bindings, see `vidyut-py`.

  • Project mention: Our Paninian word generator supports >2000 rules! | /r/sanskrit | 2023-12-05

    Our code runs against an extensive test suite of examples from the Kashika Vrtti and the Siddhanta Kaumudi. Are there bugs? Yes, and we know where most of them are due to our test suite (look for the #[ignore] annotation for tests with at least one unsupported word.) Happily, the number of bugs here is decreasing over time.

  • treebender

    A HDPSG-inspired symbolic natural language parser written in Rust

  • yozuk

    Chatbot for Programmers

  • bytepiece-rs

    The Bytepiece Tokenizer Implemented in Rust.

  • Project mention: A more general tokenizer | /r/rust | 2023-09-25
  • whatlang-pyo3

    Python Binding for Rust WhatLang, a language detection library

  • keyword-extraction-rs

    Keyword extraction algorithms in Rust

  • Project mention: Rust Keyword Extraction: Creating the YAKE! algorithm from scratch | dev.to | 2024-04-27

    All the code discussed in this article can be accessed through this repository. For integration with existing projects consider using keyword_extraction crate available on crates.io.

  • semdesk

    Semantic Desktop Search - search for answers not the file names

  • upsc3ne

    An obscenity detection API in Rust using Custom Implementations

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust NLP related posts

  • Rust Keyword Extraction: Creating the YAKE! algorithm from scratch

    2 projects | dev.to | 27 Apr 2024
  • A Paninian [Sanskrit] word generator

    1 project | news.ycombinator.com | 1 Dec 2023
  • Vale.sh – A Linter for Prose

    7 projects | news.ycombinator.com | 3 Sep 2023
  • HF Transfer: Speed up file transfers

    2 projects | /r/rust | 7 Jul 2023
  • Creating search engine for your local network - Is it even possible?

    2 projects | /r/selfhosted | 2 Jul 2023
  • Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text

    2 projects | /r/rust | 15 Jun 2023
  • Is anyone doing Machine Learning in Rust?

    6 projects | /r/rust | 11 May 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 30 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source NLP projects in Rust? This list will help you:

Project Stars
1 tokenizers 8,538
2 rust-bert 2,448
3 whatlang-rs 956
4 lingua-rs 836
5 nlprule 576
6 cargo-spellcheck 311
7 txtai.rs 99
8 vidyut 45
9 treebender 41
10 yozuk 38
11 bytepiece-rs 14
12 whatlang-pyo3 12
13 keyword-extraction-rs 9
14 semdesk 1
15 upsc3ne 1

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com