sentence-splitter
simplemma
sentence-splitter | simplemma | |
---|---|---|
1 | - | |
216 | 128 | |
6.0% | - | |
0.0 | 6.0 | |
over 1 year ago | 5 days ago | |
Python | Python | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sentence-splitter
-
Text translation question: Helsinki-NLP skips end sentences. Any good open sourced pre-trained models for large text translation?
There are plenty of sentence splitter available, like https://github.com/mediacloud/sentence-splitter for example, but sometimes you'll have to use language specific ones.
simplemma
We haven't tracked posts mentioning simplemma yet.
Tracking mentions began in Dec 2020.
What are some alternatives?
word-piece-tokenizer - A Lightweight Word Piece Tokenizer
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python
Hebrew-Tokenizer - A very simple python tokenizer for Hebrew text.
textacy - NLP, before and after spaCy
bitextor - Bitextor generates translation memories from multilingual websites
Lineflow - :zap:A Lightweight NLP Data Loader for All Deep Learning Frameworks in Python
spacy-experimental - 🧪 Cutting-edge experimental spaCy components and features
Jieba - 结巴中文分词
xontrib-output-search - Get identifiers, paths, URLs and words from the previous command output and use them for the next command in xonsh shell.
pkuseg-python - pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation
SnowNLP - Python library for processing Chinese text
PyTorch-NLP - Basic Utilities for PyTorch Natural Language Processing (NLP)