lm-scorer
Sentence-Adder-Anki-Addon
lm-scorer | Sentence-Adder-Anki-Addon | |
---|---|---|
4 | 2 | |
294 | 13 | |
- | - | |
0.0 | 4.1 | |
about 2 years ago | 3 months ago | |
Python | Python | |
MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lm-scorer
- How to obbtain probability for entire sequence (Huggingface transformers)
-
MLM vs CLM for actual language modeling
I've tried this once and found the CLM score to be a better indicator than BERT log prob for my use-case. For CLM, I had used lm-scorer.
- "simonepri/lm-scorer: Language Model based sentences scoring library" ("This package provides a simple programming interface to score sentences using different ML language models.")
-
Whole sentence rather than word frequency nltk?
As in, how generally would a sentence make sense in the totality of English? You could look into language models that give probability of a sentence. You can try a library called lm-scorer.
Sentence-Adder-Anki-Addon
-
Sentence Adder Anki Addon for any language available on tatoeba and add sentence with one click for selected words
https://github.com/infinyte7/Sentence-Adder-Anki-Addon#install-1
-
[ Sentence Adder Anki Addon ] Add sentences matching the words to editor window in Anki. [For all language available]
Download from release page Sentence Adder Anki Addon
What are some alternatives?
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
anki-addons-misc - Various add-ons I've written for Anki
penney - Penney's Game
Beautify-Anki - An Anki addon that attempts to give Anki's deck browser and deck overview pages a material design look.
Tyche - A library for probabilistic reasoning and belief modelling in Python.
pySBD - 🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
ModuleFormer - ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward experts. We released a collection of ModuleFormer-based Language Models (MoLM) ranging in scale from 4 billion to 8 billion parameters.
review-heatmap - Anki add-on to help you keep track of your review activity
eda_nlp - Data augmentation for NLP, presented at EMNLP 2019
CrowdAnki - Plugin for Anki SRS designed to facilitate cooperation on creation of notes and decks.