lemmatization-lists
thesaurus
lemmatization-lists | thesaurus | |
---|---|---|
3 | 2 | |
303 | 168 | |
- | - | |
0.0 | 3.4 | |
over 2 years ago | 4 months ago | |
Python | ||
ODC Open Database License v1.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lemmatization-lists
-
Ambiguous spellings
It's a bit of a massive undertaking maintaining such a data set so it's mostly taken from https://github.com/michmech/lemmatization-lists At the top of the file you'll see some additional I've added to deal with personal pronouns and numbers.
-
Is there a text list of words and their variations?
Another one to add to your list: https://github.com/michmech/lemmatization-lists
-
Trying to build a lemmatizer from scratch
One approach might be to take a lemmatization list, like the lemma-token lists at https://github.com/michmech/lemmatization-lists/, and compile it into a Finite State Transducer. The Helsinki FST package, for instance, has an hfst-strings2fst command to compile pairs of strings into a transducer. You might need to do some reformatting of the input first.
thesaurus
-
Ambiguous spellings
Ooh, thanks! I'm still working on something to check for more ambiguous spellings, but I'll send you something when I'm done. I'm using a thesaurus I got from here, in case you want to check that out.
-
Need help with integration of ML in blazor application.
You could use something like thesaurus to find synonyms and check if the user has some to do in the past that matches one of the synonyms.
What are some alternatives?
trankit - Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
thesaurus_query.vim - Multi-language Thesaurus Query and Replacement plugin for Vim/NeoVim
tldr-transformers - The "tl;dr" on a few notable transformer papers (pre-2022).
googler - :mag: Google from the terminal
awesome-sentiment-analysis - Repository with all what is necessary for sentiment analysis and related areas
syn - 🌾 Get synonyms and antonyms of words from Thesaurus.com and other sources in your terminal, with rich output.
Awesome-pytorch-list - A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.
wordhoard - This Python module can be used to obtain antonyms, synonyms, hypernyms, hyponyms, homophones and definitions.
eda_nlp - Data augmentation for NLP, presented at EMNLP 2019