Go Tokenizer

Open-source Go projects categorized as Tokenizer

Top 8 Go Tokenizer Projects

  • kagome

    Self-contained Japanese Morphological Analyzer written in pure Go

  • sentences

    A multilingual command line sentence tokenizer in Golang

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • tokenizer

    NLP tokenizers written in Go language (by sugarme)

  • tokenizer

    Tokenizer (lexer) for golang (by bzick)

  • goselect

    SQL like 'select' interface for files

  • assocentity

    Package assocentity returns the mean distance from tokens to an entity and its synonyms

  • shamoji

    The shamoji (杓文字) is a word filtering package

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • maleeni

    A lexer generator for golang

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Tokenizer related posts

  • maleeni: yet another lexer generator for golang

    1 project | /r/golang | 3 Jun 2021
  • How do MeCab, Kuromoji and Kagome (Japanese Text Analyzer) compare; and which dictionary to choose?

    2 projects | dev.to | 19 Mar 2021
  • Golang Modules Tutorial

    1 project | dev.to | 23 Nov 2020


What are some of the best open-source Tokenizer projects in Go? This list will help you:

Project Stars
1 kagome 792
2 sentences 424
3 tokenizer 145
4 tokenizer 87
5 goselect 29
6 assocentity 14
7 shamoji 13
8 maleeni 5

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives