Announcing ICU4X 1.0 – New Internationalization Library from Unicode

• icu4x

  25 1,252 9.8 Rust

  Solving i18n for client-side and resource-constrained environments.

  

icusegmenter implements _rule based segmentation, so you can actually customize the segmentation rules based on your needs by writing some toml and feeding it to datagen. The concept of a "character" or "word" has no single cross-linguistic meaning; it is not uncommon to need to tailor these algorithms by use case or even just the language being used. E.g. handling viramas in Indic scripts as a part of grapheme segmentation is a thing people might need, but may also not need, and UAX29 doesn't support that at the moment¹. CLDR contains a bunch of common tailorings for specific locales here, but as I mentioned folks may tailor further based on use case.

• cldr-json

  2 497 7.2 Shell

  JSON Data from the Unicode CLDR Project

  

icusegmenter implements _rule based segmentation, so you can actually customize the segmentation rules based on your needs by writing some toml and feeding it to datagen. The concept of a "character" or "word" has no single cross-linguistic meaning; it is not uncommon to need to tailor these algorithms by use case or even just the language being used. E.g. handling viramas in Indic scripts as a part of grapheme segmentation is a thing people might need, but may also not need, and UAX29 doesn't support that at the moment¹. CLDR contains a bunch of common tailorings for specific locales here, but as I mentioned folks may tailor further based on use case.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project