Our great sponsors
-
contrastive-reconstruction
Tensorflow-keras implementation for Contrastive Reconstruction (ConRec) : a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss.
-
self_supervised
Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
solo-learn
solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
-
vissl
Discontinued VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
How about this: https://github.com/bayer-science-for-a-better-life/contrastive-reconstruction
You may want to check out pip install self-supervised https://github.com/KeremTurgutlu/self_supervised which benchmarks several selfsupervised methods, here's a SimCLR tutorial https://keremturgutlu.github.io/self_supervised/01%20-%20training_simclr_iwang.html
I recently did some self supervised pretrainings (simclr, moco, Barlow twins) and used the vissl library for that which has worked pretty well for me (https://github.com/facebookresearch/vissl)
Related posts
- Positive and Negative Sampling Strategies for Representation Learning in Semantic Search
- Does anyone know how a loss curve like this can happen? Details in comments
- New “distilled diffusion models” research can create high quality images 256x faster with step counts as low as 4
- [D] Why is random cropping necessary in SimCLR?
- [R] Deep Learning with a Small Training Batch (or Lack Thereof). Part 1