AdCo
DiffCSE
| AdCo | DiffCSE | |
|---|---|---|
| 2 | 3 | |
| 161 | 286 | |
| 0.0% | - | |
| 0.9 | 0.0 | |
| about 1 year ago | over 1 year ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AdCo
-
[D] Negative examples are still useful in self-supervised learning even after the BYOL, and they are directly trainable end-to-end with a backbone.
The paper showed that with only 8196 negatives, the AdCo can achieve better performance than the SOTA self-supervised methods (MoCo V2, SimCLR, AdCo and SWAV) with fewer epochs, thus making the AdCo a very efficient self-supervised learning algorithm to pretrain a backbone. The source code has been released at https://github.com/maple-research-lab/AdCo.
-
[R] AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries
The source code is available at https://github.com/maple-research-lab/AdCo/. The paper will be presented at CVPR 2021.
DiffCSE
-
[N] MIT/Meta AI released their new SOTA unsupervised sentence embedding model "DiffCSE"
Code for https://arxiv.org/abs/2204.10298 found: https://github.com/voidism/DiffCSE
What are some alternatives?
Unsupervised-Classification - SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]
PromCSE - Code for "Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning (EMNLP 2022)"
Revisiting-Contrastive-SSL - Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]
inltk - Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need
Unsupervised-Semantic-Segmentation - Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals. [ICCV 2021]
SimCSE - [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
pytorch-metric-learning - The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.