S2-BNN
solo-learn
| S2-BNN | solo-learn | |
|---|---|---|
| 1 | 3 | |
| 61 | 1,358 | |
| - | - | |
| 2.7 | 5.9 | |
| over 2 years ago | 7 days ago | |
| Python | Python | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
S2-BNN
-
[R] Knowledge Distillation, Model Ensemble and Its Application on Visual Recognition - Link to a free online lecture by the author in comments
CVPR 2021 paper ‘S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration’, Github: https://github.com/szq0214/S2-BNN
solo-learn
- [D]Use SimCLR as pretraining for image segmentation
-
[D] State-of-the-Art for Self-Supervised (Pre-)Training of CNN architectures (e.g. ResNet)?
Hello, I lost a bit of touch to the current SOTA of self-supervised pretraining of CNNs, in particular ResNet. I found this repository https://github.com/vturrisi/solo-learn that has many methods implemented but I'm not really sure where to start. My goal is to pretrain a ResNet backbone on a decently large amount of image data that comes from a certain domain and after that fine-tune it for different downstream tasks (classification, segmentation, object detection) on a subset of the data I have labels for.
-
[P] Solo-learn 1.0.3: new methods, support for transformer architectures, better evaluation, improved docs, and additional results.
Hi Reddit, the solo-learn team is back again with interesting news about its SSL library.
What are some alternatives?
temporal-shift-module - [ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding
dino - PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO
MEAL-V2 - MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.
lightning-transformers - Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
contrastive-reconstruction - Tensorflow-keras implementation for Contrastive Reconstruction (ConRec) : a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss.
Revisiting-Contrastive-SSL - Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]
Unsupervised-Semantic-Segmentation - Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals. [ICCV 2021]
CEBRA - Learnable latent embeddings for joint behavioral and neural analysis - Official implementation of CEBRA
vectorrvnn - Data Driven method for hierarchical grouping of paths in Vector Graphics.
detrex - detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.
pytorch-forecasting - Time series forecasting with PyTorch
mmselfsup - OpenMMLab Self-Supervised Learning Toolbox and Benchmark