solo-learn
Revisiting-Contrastive-SSL
| solo-learn | Revisiting-Contrastive-SSL | |
|---|---|---|
| 3 | 1 | |
| 1,358 | 86 | |
| - | - | |
| 5.9 | 0.0 | |
| 5 days ago | over 2 years ago | |
| Python | Python | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
solo-learn
- [D]Use SimCLR as pretraining for image segmentation
-
[D] State-of-the-Art for Self-Supervised (Pre-)Training of CNN architectures (e.g. ResNet)?
Hello, I lost a bit of touch to the current SOTA of self-supervised pretraining of CNNs, in particular ResNet. I found this repository https://github.com/vturrisi/solo-learn that has many methods implemented but I'm not really sure where to start. My goal is to pretrain a ResNet backbone on a decently large amount of image data that comes from a certain domain and after that fine-tune it for different downstream tasks (classification, segmentation, object detection) on a subset of the data I have labels for.
-
[P] Solo-learn 1.0.3: new methods, support for transformer architectures, better evaluation, improved docs, and additional results.
Hi Reddit, the solo-learn team is back again with interesting news about its SSL library.
Revisiting-Contrastive-SSL
What are some alternatives?
dino - PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO
acoustic-keylogger - Pipeline of a keylogging attack using just an audio signal and unsupervised learning.
lightning-transformers - Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
DiffCSE - Code for the NAACL 2022 long paper "DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings"
contrastive-reconstruction - Tensorflow-keras implementation for Contrastive Reconstruction (ConRec) : a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss.
mmselfsup - OpenMMLab Self-Supervised Learning Toolbox and Benchmark
Unsupervised-Semantic-Segmentation - Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals. [ICCV 2021]
self-supervised - Whitening for Self-Supervised Representation Learning | Official repository
CEBRA - Learnable latent embeddings for joint behavioral and neural analysis - Official implementation of CEBRA
TS-TCC - [IJCAI-21] "Time-Series Representation Learning via Temporal and Contextual Contrasting"
vectorrvnn - Data Driven method for hierarchical grouping of paths in Vector Graphics.
PASS - The PASS dataset: pretrained models and how to get the data