lingua-py
The most accurate natural language detection library for Python, suitable for short text and mixed-language text (by pemistahl)
lingua-rs
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text (by pemistahl)
Our great sponsors
| lingua-py | lingua-rs | |
|---|---|---|
| 8 | 9 | |
| 868 | 817 | |
| - | - | |
| 7.4 | 8.9 | |
| 20 days ago | 5 days ago | |
| Python | Rust | |
| Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lingua-py
Posts with mentions or reviews of lingua-py.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-12-26.
-
Typos — automatic language recognition and error detection in Word and Excel documents
ᅠ✅ Recognition of 75 languages
-
The hand-picked selection of the best Python libraries and tools of 2022
Hi u/dekked_, perhaps you want to add my natural language detection library Lingua to the NLP section of the long tail. It is pretty unique among the natural language detection libraries for Python because it is able to detect multiple languages in mixed-language text. It is also one of the most accurate libraries when detecting the language of short text. I would very much appreciate if you added my library to your list.
- Lingua 1.2.0 - The most accurate natural language detection library for Python - now with support for detecting multiple languages in mixed-language text.
- Lingua 1.1.0 - The most accurate natural language detection library for Python
-
Lingua-Go, the most accurate language detection for Go
I've compared the Python implementation of Lingua with fasttext. Lingua performs clearly better. Look here: https://github.com/pemistahl/lingua-py#4-how-good-is-it
- Lingua 1.0.1: The most accurate natural language detection library for Python - previously for Python >= 3.9, now compatible with Python >= 3.7
- Announcing Lingua 1.0.0: The most accurate natural language detection library for Python, suitable for long and short text alike
lingua-rs
Posts with mentions or reviews of lingua-rs.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-10-23.
-
I created a program that finds out which anki cards out of 50_000 are in english and deletes them in 2 minutes
Discovery of Lingua: While working on a different project, I discovered the Lingua library.
- Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text
-
Opensourcing Whichlang, a fast language detection library for Rust! 🚀 ⚡
It is. Have you tried with this PR though? (Disclaimer: I made that PR) It'll most likely still be slower, but at least it shouldn't be catastrophically slower when using multiple threads.
-
Whatlang 0.15.0 released (lightweight lib for language recognition)
How does it compare to lingua?
- Announcing Lingua 1.4: The most accurate natural language detection library for Rust - now with WASM support
- Announcing Lingua 1.3 - The most accurate natural language detection library for Rust
-
Whatlang strikes back
For those who don't know me: I'm the author of Lingua. I've just made a comparison between the current Lingua version 1.2.0 and the new Whatlang 0.12.0. In fact, the detection accuracy of Whatlang has increased from 65% in version 0.11.1 to 74% in version 0.12.0 on average across all supported languages and detection tasks. You can find the detailed comparison here. In short:
-
Text Rendering
Language detection -> Lingua
What are some alternatives?
When comparing lingua-py and lingua-rs you can also consider the following projects:
langid.py - Stand-alone language identification system
whatlang-rs - Natural language detection library for Rust. Try demo online: https://whatlang.org/
cld3
crates.io - The Rust package registry
LSTM_langid - Source code for the Apple reproduction
allsorts - Font parser, shaping engine, and subsetter implemented in Rust
lingua-go - The most accurate natural language detection library for Go, suitable for short text and mixed-language text
whatlang-accuracy-benchmark - Accuracy benchmarks for Whatlang
cld2 - Compact Language Detector 2
sonic - 🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.
langdetect - Port of Google's language-detection library to Python.
rust-harfbuzz - Rust bindings to HarfBuzz