Top 15 Rust NLP Projects

• tokenizers

  8 8,458 8.5 Rust

  💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

  

Project mention: HF Transfer: Speed up file transfers | /r/rust | 2023-07-07

Hugging Face seems to like Rust. They also wrote Tokenizers in Rust.

• rust-bert

  7 2,427 6.8 Rust

  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Project mention: How to leverage the state-of-the-art NLP models in Rust | /r/infinilabs | 2023-06-07

brew install libtorch brew link libtorch brew ls --verbose libtorch | grep dylib export LIBTORCH=$(brew --cellar pytorch)/$(brew info --json pytorch | jq -r '.[0].installed[0].version') export LD_LIBRARY_PATH=${LIBTORCH}/lib:$LD_LIBRARY_PATH git clone https://github.com/guillaume-be/rust-bert.git cd rust-bert ORT_STRATEGY=system cargo run --example sentence_embeddings

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whatlang-rs

  7 952 5.1 Rust

  Natural language detection library for Rust. Try demo online: https://whatlang.org/

Project mention: Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text | /r/rust | 2023-06-15

How does it compare to whatlang?

• lingua-rs

  9 824 8.9 Rust

  The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

Project mention: I created a program that finds out which anki cards out of 50_000 are in english and deletes them in 2 minutes | /r/rust | 2023-10-23

Discovery of Lingua: While working on a different project, I discovered the Lingua library.

• nlprule

  5 574 0.0 Rust

  A fast, low-resource Natural Language Processing and Text Correction library written in Rust.

Project mention: Vale.sh – A Linter for Prose | news.ycombinator.com | 2023-09-03

Another interesting projects in the space:

- nlprule: https://github.com/bminixhofer/nlprule

- prosemd: https://github.com/kitten/prosemd-lsp

- cargo spellcheck: https://github.com/drahnr/cargo-spellcheck

• cargo-spellcheck

  1 310 7.8 Rust

  Checks all your documentation for spelling and grammar mistakes with hunspell and a nlprule based checker for grammar

Project mention: Vale.sh – A Linter for Prose | news.ycombinator.com | 2023-09-03

Another interesting projects in the space:

- nlprule: https://github.com/bminixhofer/nlprule

- prosemd: https://github.com/kitten/prosemd-lsp

- cargo spellcheck: https://github.com/drahnr/cargo-spellcheck

• txtai.rs

  6 98 4.6 Rust

  Rust client for txtai

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• vidyut

  5 44 7.2 Rust

  Infrastructure for Sanskrit software. For Python bindings, see `vidyut-py`.

  

Project mention: Our Paninian word generator supports >2000 rules! | /r/sanskrit | 2023-12-05

Our code runs against an extensive test suite of examples from the Kashika Vrtti and the Siddhanta Kaumudi. Are there bugs? Yes, and we know where most of them are due to our test suite (look for the #[ignore] annotation for tests with at least one unsupported word.) Happily, the number of bugs here is decreasing over time.

• treebender

  1 39 0.0 Rust

  A HDPSG-inspired symbolic natural language parser written in Rust

• yozuk

  1 37 10.0 Rust

  Chatbot for Programmers

  

• bytepiece-rs

  1 14 7.4 Rust

  The Bytepiece Tokenizer Implemented in Rust.

Project mention: A more general tokenizer | /r/rust | 2023-09-25

• whatlang-pyo3

  2 11 4.6 Rust

  Python Binding for Rust WhatLang, a language detection library

• keyword-extraction-rs

  2 9 8.8 Rust

  Keyword extraction algorithms in Rust

Project mention: Rust Keyword Extraction: Creating the YAKE! algorithm from scratch | dev.to | 2024-04-27

All the code discussed in this article can be accessed through this repository. For integration with existing projects consider using keyword_extraction crate available on crates.io.

• semdesk

  1 1 4.5 Rust

  Semantic Desktop Search - search for answers not the file names

• upsc3ne

  2 1 0.6 Rust

  An obscenity detection API in Rust using Custom Implementations

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Rust NLP related posts

• Rust Keyword Extraction: Creating the YAKE! algorithm from scratch

  2 projects | dev.to | 27 Apr 2024

• A Paninian [Sanskrit] word generator

  1 project | news.ycombinator.com | 1 Dec 2023

• Vale.sh – A Linter for Prose

  7 projects | news.ycombinator.com | 3 Sep 2023

• HF Transfer: Speed up file transfers

  2 projects | /r/rust | 7 Jul 2023

• Creating search engine for your local network - Is it even possible?

  2 projects | /r/selfhosted | 2 Jul 2023

• Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text

  2 projects | /r/rust | 15 Jun 2023

• Is anyone doing Machine Learning in Rust?

  6 projects | /r/rust | 11 May 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 10 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Rust projects with our weekly report!