tokenizer
NLP tokenizers written in Go language (by sugarme)
cybertron
Cybertron: the home planet of the Transformers in Go (by nlpodyssey)
tokenizer | cybertron | |
---|---|---|
1 | 1 | |
140 | 258 | |
- | 4.3% | |
6.1 | 7.2 | |
2 months ago | 4 months ago | |
Go | Go | |
Apache License 2.0 | BSD 2-clause "Simplified" License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tokenizer
Posts with mentions or reviews of tokenizer.
We have used some of these posts to build our list of alternatives
and similar projects.
-
Golang Modules Tutorial
The github repository of tokenizer can be checked here.
cybertron
Posts with mentions or reviews of cybertron.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-11.
What are some alternatives?
When comparing tokenizer and cybertron you can also consider the following projects:
maleeni - A lexer generator for golang
t2 - Traduction Translation aka T2 can help you improve when writing in a foreign language.
spaGO - Self-contained Machine Learning and Natural Language Processing library in Go
go-torch - LibTorch (PyTorch) bindings for Golang
sentences - A multilingual command line sentence tokenizer in Golang
kagome - Self-contained Japanese Morphological Analyzer written in pure Go