Transformer-SSL
pytorch-metric-learning
Our great sponsors
| Transformer-SSL | pytorch-metric-learning | |
|---|---|---|
| 2 | 3 | |
| 589 | 5,764 | |
| 0.0% | - | |
| 0.0 | 7.9 | |
| almost 3 years ago | 28 days ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Transformer-SSL
-
[R] A new baseline and codebase for self-supervised learning (SSL) with ViT/Swin-Transformer (Microsoft Research)
Github: https://github.com/SwinTransformer/Transformer-SSL
- [P] A new codebase for self-supervised learning with vision Transformers that provides evaluation on down-stream tasks of object detection and semantic segmentation
pytorch-metric-learning
-
Similarity Learning lacks a framework. So we built one
Not a full featured framework, but pytorch-metric-learning has data loaders, lossess, etc. to facilitate similarity learning: https://github.com/KevinMusgrave/pytorch-metric-learning
Disclaimer: I've made some contributions to it.
-
[R][D] VAE Embedding Space - Can we force it to learn a metric?
You can use the triplet loss together with the Gaussian prior. It will be zero centered though and the clusters are not as separated when you use the triplet loss only.There are many alternative to the triplet loss, in case it needs to be a metric: https://github.com/KevinMusgrave/pytorch-metric-learning
-
[D] Similar Image Retrieval
This repo provides the tools and examples needed to build such a model: https://github.com/KevinMusgrave/pytorch-metric-learning
What are some alternatives?
dino - PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO
byol-pytorch - Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
lightly - A python library for self-supervised learning on images.
EasyOCR - Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
Unsupervised-Classification - SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]
autogluon - Fast and Accurate ML in 3 Lines of Code
simsiam-cifar10 - Code to train the SimSiam model on cifar10 using PyTorch
similarity - TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
ComboLoss - Official PyTorch Implementation for Paper <ComboLoss for Facial Attractiveness Analysis with Squeeze-and-Excitation Networks> (State-of-the-art Performance on 3 Popular Benchmark Dataset)