simclr
deepmind-research
Our great sponsors
simclr | deepmind-research | |
---|---|---|
13 | 29 | |
3,927 | 12,802 | |
1.8% | 2.2% | |
2.9 | 0.6 | |
11 months ago | 7 days ago | |
Jupyter Notebook | Jupyter Notebook | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
simclr
-
Positive and Negative Sampling Strategies for Representation Learning in Semantic Search
For visual representations, you could look into SimCLR and MoCo. https://github.com/google-research/simclr https://github.com/facebookresearch/moco
-
[D] Why is random cropping necessary in SimCLR?
Yeah I think so, it's not hard to check https://github.com/google-research/simclr/blob/2fc637bdd6a723130db91b377ac15151e01e4fc2/data_util.py
-
[R] Deep Learning with a Small Training Batch (or Lack Thereof). Part 1
Code for https://arxiv.org/abs/2006.10029 found: https://github.com/google-research/simclr
-
[D] Current trends in computer vision related to unsupervised learning
SimCLR v2.0 - https://arxiv.org/abs/2006.10029
-
Self-Supervised Contrastive Learning model for video dataset?
My data consists of binary labels (normal & anomalous) where the videos are already broken up into frames in the directory, I'm looking for a model where I can feed a normal-labeled video alongside an anomalous-labeled video like visualized in this example from the SimCLR Repo, a dog will represent the normal video and the chair the anomalous video.
-
[P] Choosing a self-supervised learning framework that's easy to use
No, go to the "tf2" folder in the repo root. https://github.com/google-research/simclr/tree/master/tf2
-
[D] What is meant by width in the SimCLRv2 paper?
Code for https://arxiv.org/abs/2006.10029 found: https://github.com/google-research/simclr
-
[D] Funding PhD in Europe
[1] https://github.com/google-research/simclr [2] https://www.tensorflow.org/tfrc?hl=en&authuser=2
deepmind-research
- This A.I. Subculture's Motto: Go, Go, Go. The eccentric pro-tech movement known as "Effective Accelerationism" wants to unshackle powerful A.I., and party along the way.
-
How worried are you about AI taking over music?
Deepmind 63
-
Are there Notebooks of AlphaFold 1?
Found some here and here.
-
Trying to port this non-standard Tensorflow model to Pytorch and not sure if I'm missing anything
I am trying to make a physics-simulation model based on DeepMind's research, with its source code found here https://github.com/deepmind/deepmind-research/tree/master/learning_to_simulate . The thing that mainly confuses me is how to properly implement the embedding situation found at https://github.com/deepmind/deepmind-research/blob/master/learning_to_simulate/learned_simulator.py on lines 78 and 152.
-
[D] Is it possible to use machine learning to create 3D images for the purpose of 3D printing?
Yes. There's a fair bit of research into using ML to generate 3D models. Early work, like Neural Radiance Fields (NeRF) generated a voxel model, which could be used for 3D printing, but it would be low resolution, like blowing up a tiny image vs an SVG vector file. However, more recent research can generate polygonal models from a video taken of a real object. Polygonal models are much better for 3D printing.
- DeepMind Research – code to accompany DeepMind publications
- Skilful precipitation nowcasting using deep generative models of radar - Dr. Piotr Mirowski - Zoom
-
[R] Skilful precipitation nowcasting using deep generative models of radar - Link to a free online lecture by the author in comments (deepmind research published in nature)
Skilful precipitation nowcasting using deep generative models of radar https://www.nature.com/articles/s41586-021-03854-z https://deepmind.com/blog/article/nowcasting https://github.com/deepmind/deepmind-research/tree/master/nowcasting
-
Deepmind Open-Sources DM21: A Deep Learning Model For Quantum Chemistry
Github: https://github.com/deepmind/deepmind-research/tree/master/density_functional_approximation_dm21
-
[P] Choosing a self-supervised learning framework that's easy to use
BYOL - again, it seems that it's not optimized for running on multiple GPUs.
What are some alternatives?
swav - PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882
jaxline
Unsupervised-Classification - SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]
dm-haiku - JAX-based neural network library
unsupervised-depth-completion-visual-inertial-odometry - Tensorflow and PyTorch implementation of Unsupervised Depth Completion from Visual Inertial Odometry (in RA-L January 2020 & ICRA 2020)
RETRO-pytorch - Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
SimCLR - PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
flax - Flax is a neural network library for JAX that is designed for flexibility.
torchlars - A LARS implementation in PyTorch
alphafold_pytorch - An implementation of the DeepMind's AlphaFold based on PyTorch for research
Supervised-Constrastive-Learning-in-TensorFlow-2 - Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al. [Moved to: https://github.com/sayakpaul/Supervised-Contrastive-Learning-in-TensorFlow-2]