DiffCSE
pytorch-metric-learning

DiffCSE | pytorch-metric-learning | |
---|---|---|
3 | 3 | |
293 | 6,085 | |
1.0% | 0.5% | |
0.0 | 8.7 | |
over 2 years ago | 2 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
DiffCSE
-
[N] MIT/Meta AI released their new SOTA unsupervised sentence embedding model "DiffCSE"
Code for https://arxiv.org/abs/2204.10298 found: https://github.com/voidism/DiffCSE
pytorch-metric-learning
-
Similarity Learning lacks a framework. So we built one
Not a full featured framework, but pytorch-metric-learning has data loaders, lossess, etc. to facilitate similarity learning: https://github.com/KevinMusgrave/pytorch-metric-learning
Disclaimer: I've made some contributions to it.
-
[R][D] VAE Embedding Space - Can we force it to learn a metric?
You can use the triplet loss together with the Gaussian prior. It will be zero centered though and the clusters are not as separated when you use the triplet loss only.There are many alternative to the triplet loss, in case it needs to be a metric: https://github.com/KevinMusgrave/pytorch-metric-learning
-
[D] Similar Image Retrieval
This repo provides the tools and examples needed to build such a model: https://github.com/KevinMusgrave/pytorch-metric-learning
What are some alternatives?
Revisiting-Contrastive-SSL - Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]
lightly - A python library for self-supervised learning on images.
Unsupervised-Semantic-Segmentation - Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals. [ICCV 2021]
dino - PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO
SimCSE - [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
similarity - TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
Unsupervised-Classification - SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]
autogluon - Fast and Accurate ML in 3 Lines of Code
inltk - Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need
simsiam-cifar10 - Code to train the SimSiam model on cifar10 using PyTorch
PromCSE - [EMNLP 2022] Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning
Transformer-SSL - This is an official implementation for "Self-Supervised Learning with Swin Transformers".
