Whatlang strikes back

• whatlang-rs

  7 950 5.1 Rust

  Natural language detection library for Rust. Try demo online: https://whatlang.org/

Regarding Chinese / Japanese, if I got it correctly Japanese may include Katakana, Hiragana and Mandarin, while Chinese includes only Mandarin characters (again I can be wrong here).

• sonic

  48 19,419 7.0 Rust

  🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.

There is at least one major user of whatlang, which I am very proud of, it's Sonic, a fast and lightweight search backend, written in also Rust.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Seed

  36 3,786 4.2 Rust

  A Rust framework for creating web apps

  

With that I also created a homepage for Whatlang: https://whatlang.org/. This a little single page application implemented fully in Rust (thanks to Seed), where you can interactively play with the library and take a little look inside of it (if you click "Debug" tab).

• whatlang-website

  1 2 0.0 JavaScript

  Website for whatlang (whatlang.org)

Not really. I am not native german speaker, also I was already quite tired in the night when I was finish it. I just wanted to put some funny text there so it can catch attention. If you feel like you can fix something you can send a little PR: https://github.com/greyblake/whatlang-website/blob/master/src/demo.rs#L13-L14

• crates.io

  660 2,796 10.0 Rust

  The Rust package registry

  

Lingua is available on crates.io,they made an exception for it (you can find that within comments)

• lingua-rs

  9 817 8.9 Rust

  The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

For those who don't know me: I'm the author of Lingua. I've just made a comparison between the current Lingua version 1.2.0 and the new Whatlang 0.12.0. In fact, the detection accuracy of Whatlang has increased from 65% in version 0.11.1 to 74% in version 0.12.0 on average across all supported languages and detection tasks. You can find the detailed comparison here. In short:

• whatlang-accuracy-benchmark

  1 0 0.0 Rust

  Accuracy benchmarks for Whatlang

  

I did not dare to compete with you in accuracy, so my main focus to improve just to compete with my own old version of whatlang. So I had to setup some benchmarks: https://github.com/whatlang/whatlang-accuracy-benchmark/blob/master/reports/2021-04-18-v0-12-0.md

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project