Top 23 language-detection Open-Source Projects

• franc

  1 4,028 5.4 JavaScript

  Natural language detection

• spark-nlp

  87 3,682 9.4 Scala

  State of the Art Natural Language Processing

  

Project mention: Spark NLP 5.1.0: Introducing state-of-the-art OpenAI Whisper speech-to-text, OpenAI Embeddings and Completion transformers, MPNet text embeddings, ONNX support for E5 text embeddings, new multi-lingual BART Zero-Shot text classification, and much more! | /r/Python | 2023-09-06

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• react-native-localize

  3 2,202 7.4 TypeScript

  🌍 A toolbox for your React Native app localization

• google-translate-php

  1 1,737 6.8 PHP

  🔤 Free Google Translate API PHP Package. Translates totally free of charge.

• lingua-go

  7 1,095 5.3 Go

  The most accurate natural language detection library for Go, suitable for short text and mixed-language text

• lingua-py

  8 881 7.4 Python

  The most accurate natural language detection library for Python, suitable for short text and mixed-language text

Project mention: Typos — automatic language recognition and error detection in Word and Excel documents | /r/microsoftoffice | 2023-10-27

ᅠ✅ Recognition of 75 languages

• lingua-rs

  9 820 8.9 Rust

  The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

Project mention: I created a program that finds out which anki cards out of 50_000 are in english and deletes them in 2 minutes | /r/rust | 2023-10-23

Discovery of Lingua: While working on a different project, I discovered the Lingua library.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• nlu

  25 809 8.6 Python

  1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.

  

• language-detection

  0 792 2.7 PHP

  A language detection library for PHP. Detects the language from a given text string.

• lingua

  8 657 6.3 Kotlin

  The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

• malaya

  1 456 9.0 Jupyter Notebook

  Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/

  

• tinyld

  2 396 3.9 TypeScript

  Simple and Performant Language detection library for NodeJS

  

• hms-ml-demo

  4 347 4.5 Java

  HMS ML Demo provides an example of integrating Huawei ML Kit service into applications. This example demonstrates how to integrate services provided by ML Kit, such as face detection, text recognition, image segmentation, asr, and tts.

  

• whichlang

  3 341 5.1 Rust

  A blazingly fast and lightweight language detection library for Rust

  

Project mention: Show HN: Quickwit – Cost-efficient Elasticsearch alternative on object storage | news.ycombinator.com | 2023-06-07

- Another nice comment seen on HN « it seems to be very easy to run, not very IO intensive, and running fine on a single node with modest hardware with >2 billion log rows. It has a really cool dynamic schema feature too.» [9]

Fun fact: at least 4 users are using Garage[10] as the object storage, this OSS project looks really promising and made the HN front page a few months ago[11], we really cherish the OSS for this kind of unexpected combination.

Any feedback positive/negative always greatly appreciated here!

[0] Quickwit repo: https://github.com/quickwit-oss/quickwit

[1] Searching the web under 1000$/month: https://news.ycombinator.com/item?id=27074481

[2] Chitchat gossip library: https://github.com/quickwit-oss/chitchat

[3] Columnar format: https://github.com/quickwit-oss/tantivy/tree/main/columnar

[4] Tantivy library: https://github.com/quickwit-oss/tantivy/

[5] Whichlang library: https://github.com/quickwit-oss/whichlang

[6] GitHub Archive demo in terminal: https://www.youtube.com/watch?v=SNq3bARRlDI

[7] Indexing performance: https://twitter.com/fulmicoton/status/1638016949459488768

[8] https://twitter.com/arnonrgo/status/1645429632303235073?s=20

[9] https://news.ycombinator.com/item?id=35742544

[10] Garage object storage: https://garagehq.deuxfleurs.fr/

[11] https://news.ycombinator.com/item?id=33853539

• L10n-swift

  0 313 0.0 Swift

  Localization of the application with ability to change language "on the fly" and support for plural form in any language.

• Google Translate For Free

  0 131 0.0 PHP

  Library for free use Google Translator. With attempts connecting on failure and array support.

• simplemma

  0 125 5.2 Python

  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

• Paasaa

  0 113 5.0 Elixir

  🔤 Natural language detection for Elixir

• guess-language.el

  1 111 10.0 Emacs Lisp

  Emacs minor mode that detects the language you're typing in. Automatically switches spell checker. Supports multiple languages per document.

• pastey

  5 96 0.0 HTML

  A lightweight, self-hosted paste platform

• efficient-language-detector

  2 38 6.8 PHP

  Fast and accurate natural language detection. Detector written in PHP. Nito-ELD, ELD.

Project mention: My first public Repository: Efficient Language Detector. | /r/PHP | 2023-06-16

Same with copyright: Having a legal.md or licence.md is sufficient. If you really feel like it you can add ONE line to each file pointing to the readme /** legal info: https://github.com/nitotm/efficient-language-detector/blob/main/readme.md */

• py3langid

  0 33 0.0 Python

  Faster, modernized fork of the language identification tool langid.py

• detectlanguage

  1 24 0.0 Go

  Detect Language API Go Client

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

language-detection related posts

• Typos — automatic language recognition and error detection in Word and Excel documents
  1 project | /r/microsoftoffice | 27 Oct 2023
• I created a program that finds out which anki cards out of 50_000 are in english and deletes them in 2 minutes
  3 projects | /r/rust | 23 Oct 2023
• My first public Repository: Efficient Language Detector.
  3 projects | /r/PHP | 16 Jun 2023
• Show HN: Quickwit – Cost-efficient Elasticsearch alternative on object storage
  5 projects | news.ycombinator.com | 7 Jun 2023
• Whichlang – Fast, OSS for Language Detection in Rust
  2 projects | news.ycombinator.com | 19 May 2023
• Whichlang – Fast, OSS for Language Detection in Rust
  1 project | /r/hypeurls | 19 May 2023
• Opensourcing Whichlang, a fast language detection library for Rust! 🚀 ⚡
  1 project | /r/rust | 19 May 2023
• A note from our sponsor - SaaSHub
  www.saashub.com | 30 Apr 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com