maleeni
A lexer generator for golang (by nihei9)
tokenizer
NLP tokenizers written in Go language (by sugarme)
Our great sponsors
| maleeni | tokenizer | |
|---|---|---|
| 1 | 1 | |
| 5 | 138 | |
| - | - | |
| 0.0 | 6.1 | |
| about 2 years ago | 2 months ago | |
| Go | Go | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
maleeni
Posts with mentions or reviews of maleeni.
We have used some of these posts to build our list of alternatives
and similar projects.
-
maleeni: yet another lexer generator for golang
I have implemented a lexer generator for golang. The repository is here github.com/nihei9/maleeni.
tokenizer
Posts with mentions or reviews of tokenizer.
We have used some of these posts to build our list of alternatives
and similar projects.
-
Golang Modules Tutorial
The github repository of tokenizer can be checked here.
What are some alternatives?
When comparing maleeni and tokenizer you can also consider the following projects:
libfsm - DFA regular expression library & friends
spaGO - Self-contained Machine Learning and Natural Language Processing library in Go
netz - Discover internet-wide misconfigurations while drinking coffee
sentences - A multilingual command line sentence tokenizer in Golang
tokenizer - Tokenizer (lexer) for golang
kagome - Self-contained Japanese Morphological Analyzer written in pure Go
participle - A parser library for Go
chris - Pratt parser implementation in Go
goselect - SQL like 'select' interface for files
tokenizer - Pure Go implementation of OpenAI's tiktoken tokenizer