Review of unsupervised deep learning approaches?

• lightly

  16 2,741 9.0 Python

  A python library for self-supervised learning on images.

  

Hi, I assume you also refer to what some call now self-supervised learning. There are a bunch of exciting new methods. I would highly recommend to look at SimCLR and MoCo for contrastive learning. You can get ~90% accuracy on cifar10 with the learned features which is very good. I also worked with SimSiam (Siamese network), which can work even better but from my experience is less stable during training. There are other methods (BYOL, SwAV, and more). The field ist just getting a lot of attention. If you want to play around with some of the methods (simclr, moco and simsiam) you can have a look at lightly: https://github.com/lightly-ai/lightly It’s built on top of PyTorch and makes it very easy to train models using self supervision.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project