A Lightweight Word Piece Tokenizer
Why do you think that https://github.com/adbar/simplemma is a good alternative to word-piece-tokenizer
A Lightweight Word Piece Tokenizer
Why do you think that https://github.com/adbar/simplemma is a good alternative to word-piece-tokenizer