PromCSE
DiffCSE
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PromCSE
-
State of the Art in Sentence Embeddings
To answer your question about sentence embedding SOTA, it is not s-Bert and hasn't been for a while. SimCSE officially takes the crown since it's been presented at a conference, though according to paperswithcode's benchmark leaderboard there are other papers on arxiv that report higher performance on STS and similar tasks such as DCPCSE. Having tried both of these for my use case I found SimCSE to be better but YMMV.
DiffCSE
-
[N] MIT/Meta AI released their new SOTA unsupervised sentence embedding model "DiffCSE"
Code for https://arxiv.org/abs/2204.10298 found: https://github.com/voidism/DiffCSE
What are some alternatives?
nlu - 1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.
Revisiting-Contrastive-SSL - Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]
SimCSE - [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
Unsupervised-Classification - SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]
BERTopic - Leveraging BERT and c-TF-IDF to create easily interpretable topics.
inltk - Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need
Unsupervised-Semantic-Segmentation - Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals. [ICCV 2021]
pytorch-metric-learning - The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.