cld3
By google
lingua
The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike (by pemistahl)
| cld3 | lingua | |
|---|---|---|
| 6 | 8 | |
| 749 | 658 | |
| 0.9% | - | |
| 0.0 | 6.0 | |
| 12 months ago | 19 days ago | |
| C++ | Kotlin | |
| Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cld3
Posts with mentions or reviews of cld3.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-10.
-
cld3: Rust binding for Compact Language Detector v3 (CLD3), a neural network model for language identification.
the C++ code is from https://github.com/google/cld3
- Lingua-Go, the most accurate language detection for Go
-
Announcing Lingua 1.0.0: The most accurate natural language detection library for Python, suitable for long and short text alike
Python is widely used in natural language processing, so there are a couple of comprehensive open source libraries for this task, such as Google's CLD 2 and CLD 3, langid and langdetect. Unfortunately, except for the last one they have two major drawbacks:
-
Best C# library to detect the language of user input strings without calling external APIs like Google Translate etc?
I was looking for something like that for .net app and ended up using this https://github.com/google/cld3
-
Using char n grams as input to a neural network
I used it a lot in the models I work on. For example, we used it on a widely used project called CLD3 (https://github.com/google/cld3). The performance is great.
- Language Detection - Pre Trained Models
lingua
Posts with mentions or reviews of lingua.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-10-27.
- Announcing Lingua 1.2.0 - The most accurate natural language detection library for the JVM, suitable for long and short text alike
-
r/argentina es el subreddit de habla hispana mas popular del sitio
select 'r/'||subreddit sub , initcap(lang) language , count(*) c , ratio_to_report(c) over(partition by sub) ratio , sum(iff(language!='English', c, 0)) over(partition by sub) total_not_english , sum(c) over(partition by sub) total from reddit_sample_languages_udtf group by 1, 2 qualify ratio > .02 order by total_not_english desc, c desc, 1, ratio desc- Jason Baumgartner for collecting and sharing Reddit’s comments. - Peter M. Stahl for the Lingua project to detect languages in Java. - Snowflake for making it easy to run Java code in a UDF.
-
The most popular languages on Reddit, after analyzing 1M comments: English, German, Spanish, Portuguese, French, Italian, Romanian, Dutch... [OC]
I don't speak most of these languages, so I wasn't able to verify -- instead I just used the results of this library: https://github.com/pemistahl/lingua
-
Hazelcast + Kibana: best buddies for exploring and visualizing data
A linguist can infer the language of the field. It's also possible to use an automated process in the pipeline. A couple of NLP libraries are available in the JVM ecosystem, but I set my eyes on Lingua, one focused on language recognition.
- Usando a Biblioteca Lingua para Kotlin
- Language Detection - Pre Trained Models
- Lingua 1.1.0 released - The most accurate natural language detection library for the JVM
-
Free and easy to use Java language detection library
I've used this one previously, and found it pretty easy to use, relatively fast, and accurate: https://github.com/pemistahl/lingua
What are some alternatives?
When comparing cld3 and lingua you can also consider the following projects:
ntextcat
language-detection-cld2 - Natural language detection, Java bindings for CLD2
langdetect - Port of Google's language-detection library to Python.
Beagle - Beagle helps you identify keywords, phrases, regexes, and complex search queries of interest in streams of text documents.
lingua-py - The most accurate natural language detection library for Python, suitable for short text and mixed-language text
kotlin-logging - Lightweight Multiplatform logging framework for Kotlin. A convenient and performant logging facade.
cld2 - Compact Language Detector 2
cld3-kotlin - Bindings to Google's Compact Language Detector 3 to JVM Based Languages
lingua-go - The most accurate natural language detection library for Go, suitable for short text and mixed-language text
kovenant - Kovenant. Promises for Kotlin.
LSTM_langid - Source code for the Apple reproduction
KtUnits - Simple unit conversion library for Kotlin