Transformer-SSL
pytorch-metric-learning
Transformer-SSL | pytorch-metric-learning | |
---|---|---|
2 | 3 | |
639 | 6,081 | |
2.3% | 0.4% | |
0.0 | 8.7 | |
almost 4 years ago | 2 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Transformer-SSL
-
[R] A new baseline and codebase for self-supervised learning (SSL) with ViT/Swin-Transformer (Microsoft Research)
Github: https://github.com/SwinTransformer/Transformer-SSL
- [P] A new codebase for self-supervised learning with vision Transformers that provides evaluation on down-stream tasks of object detection and semantic segmentation
pytorch-metric-learning
-
Similarity Learning lacks a framework. So we built one
Not a full featured framework, but pytorch-metric-learning has data loaders, lossess, etc. to facilitate similarity learning: https://github.com/KevinMusgrave/pytorch-metric-learning
Disclaimer: I've made some contributions to it.
-
[R][D] VAE Embedding Space - Can we force it to learn a metric?
You can use the triplet loss together with the Gaussian prior. It will be zero centered though and the clusters are not as separated when you use the triplet loss only.There are many alternative to the triplet loss, in case it needs to be a metric: https://github.com/KevinMusgrave/pytorch-metric-learning
-
[D] Similar Image Retrieval
This repo provides the tools and examples needed to build such a model: https://github.com/KevinMusgrave/pytorch-metric-learning
What are some alternatives?
dino - PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO
lightly - A python library for self-supervised learning on images.
byol-pytorch - Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
autogluon - Fast and Accurate ML in 3 Lines of Code
Unsupervised-Classification - SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]
similarity - TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
PaddleSpeech - Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
simsiam-cifar10 - Code to train the SimSiam model on cifar10 using PyTorch
awesome-metric-learning - 😎 A curated list of awesome practical Metric Learning and its applications
barlowtwins - Implementation of Barlow Twins paper