whatlang-rs
Natural language detection library for Rust. Try demo online: https://whatlang.org/ (by greyblake)
lingua-rs
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text (by pemistahl)
Our great sponsors
| whatlang-rs | lingua-rs | |
|---|---|---|
| 7 | 9 | |
| 950 | 817 | |
| - | - | |
| 5.1 | 8.9 | |
| about 1 month ago | 8 days ago | |
| Rust | Rust | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
whatlang-rs
Posts with mentions or reviews of whatlang-rs.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-15.
-
Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text
How does it compare to whatlang?
-
Python Binding for WhatLang (Detect languages) - Blazing Fast ⚡
WhatLang is a Python library for detecting the language of a text. It is based on the WhatLang Rust library.
-
To people with real Rusty jobs: How did you land it? What exactly do you do at your job? How proficient are you? What skills besides Rust? How long did it take?
I started working on whatlang project (https://github.com/greyblake/whatlang-rs). In 2017 I started going to Rust interviews. At that moment there were only 3 companies in Berlin that were offering Rust jobs (as far as I know): Parity, Mozilla, 1aim. I had interview with all of them and did not pass. I had classical Ruby/web background, and at that moment Rust was seen as alternative to C++, so many would expect me to know C++ well (but it was not really the case). I did continue working on my open source projects and writing blog posts from time to time. Year 2020 was very different. I was like rust turned from underdog to mainstream. I felt like Rust job openings tripled. Head hunters started writing me on LinkedIn, waw! I got contacted by big CryptoExchange, because they wanted to use my library for technical analysis. Sounds like a dream! Eventually, I find a job at Impero.com, thanks to this subreddit. They posted a job description and I send them my CV. Soon I got hired. It's a remote job, but at that moment it did not make a difference, because of the pandemic.
-
Whatlang 0.15.0 released (lightweight lib for language recognition)
CHANGELOG: https://github.com/greyblake/whatlang-rs/blob/master/CHANGELOG.md
- Whatlang: A Natural language detection library for Rust
-
Whatlang strikes back
Regarding Chinese / Japanese, if I got it correctly Japanese may include Katakana, Hiragana and Mandarin, while Chinese includes only Mandarin characters (again I can be wrong here).
lingua-rs
Posts with mentions or reviews of lingua-rs.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-10-23.
-
I created a program that finds out which anki cards out of 50_000 are in english and deletes them in 2 minutes
Discovery of Lingua: While working on a different project, I discovered the Lingua library.
- Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text
-
Opensourcing Whichlang, a fast language detection library for Rust! 🚀 ⚡
It is. Have you tried with this PR though? (Disclaimer: I made that PR) It'll most likely still be slower, but at least it shouldn't be catastrophically slower when using multiple threads.
-
Whatlang 0.15.0 released (lightweight lib for language recognition)
How does it compare to lingua?
- Announcing Lingua 1.4: The most accurate natural language detection library for Rust - now with WASM support
- Announcing Lingua 1.3 - The most accurate natural language detection library for Rust
-
Whatlang strikes back
For those who don't know me: I'm the author of Lingua. I've just made a comparison between the current Lingua version 1.2.0 and the new Whatlang 0.12.0. In fact, the detection accuracy of Whatlang has increased from 65% in version 0.11.1 to 74% in version 0.12.0 on average across all supported languages and detection tasks. You can find the detailed comparison here. In short:
-
Text Rendering
Language detection -> Lingua
What are some alternatives?
When comparing whatlang-rs and lingua-rs you can also consider the following projects:
regex - An implementation of regular expressions for Rust. This implementation uses finite automata and guarantees linear time matching on all inputs.
lingua-py - The most accurate natural language detection library for Python, suitable for short text and mixed-language text
Fluent - Rust implementation of Project Fluent
crates.io - The Rust package registry
textwrap - An efficient and powerful Rust library for word wrapping text.
allsorts - Font parser, shaping engine, and subsetter implemented in Rust
suffix - Fast suffix arrays for Rust (with Unicode support).
whatlang-accuracy-benchmark - Accuracy benchmarks for Whatlang
ngrams - (Read-only) Generate n-grams
sonic - 🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.
UNIC - UNIC: Unicode and Internationalization Crates for Rust
rust-harfbuzz - Rust bindings to HarfBuzz