ContraD VS AdamP

Compare ContraD vs AdamP and see what are their differences.

ContraD

Code for the paper "Training GANs with Stronger Augmentations via Contrastive Discriminator" (ICLR 2021) (by jh-jeong)
Deep Learning generative-adversarial-network Gan contrastive-learning unsupervised-learning data-augmentation iclr2021 Pytorch
Source Code
openreview.net
Suggest alternative
Edit details

AdamP

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021) (by clovaai)
Deep Learning Optimizer optimizer-algorithms Machine Learning Pytorch iclr2021
Source Code
clovaai.github.io
Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
ContraD AdamP
1 1
189 409
- 1.5%
0.0 0.0
over 2 years ago over 3 years ago
Python Python
MIT License MIT License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

ContraD

Posts with mentions or reviews of ContraD. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-06-04.
  • [D] What is the smallest dataset you styleGAN2 trained?
    2 projects | /r/MachineLearning | 4 Jun 2021
    Well, I've been trying to train a 1024 GAN from scratch on stylegan2-ada-pytorch with a small dataset 300 samples of not so diversity in images of painting faces. Fact is that on first try FID went as low as 71 and started deteriorating. Now I x-flip augmented the dataset (700 images) and at 900kimg FID went 64 but I doubt it will get lower. I lowered the learning rate to 0.0001 as they say it might help... Recently found this way of dataset augmentation... probably will use this https://github.com/jh-jeong/ContraD

AdamP

Posts with mentions or reviews of AdamP. We have used some of these posts to build our list of alternatives and similar projects.

What are some alternatives?

When comparing ContraD and AdamP you can also consider the following projects:

stylegan2-ada-pytorch - StyleGAN2-ADA - Official PyTorch implementation

horovod - Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

co-mod-gan - [ICLR 2021, Spotlight] Large Scale Image Completion via Co-Modulated Generative Adversarial Networks

sam - SAM: Sharpness-Aware Minimization (PyTorch)

similarity - TensorFlow Similarity is a python package focused on making similarity learning quick and easy.

Adan - Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

DETReg - Official implementation of the CVPR 2022 paper "DETReg: Unsupervised Pretraining with Region Priors for Object Detection".

OASIS - Official implementation of the paper "You Only Need Adversarial Supervision for Semantic Image Synthesis" (ICLR 2021)

pytorch-CycleGAN-and-pix2pix - Image-to-Image Translation in PyTorch

EasyOCR - Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

LinkDist - Distillation Self-Knowledge From Contrastive Links to Classify Graph Nodes Without Passing Messages.

yolov5 - YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite

ContraD vs stylegan2-ada-pytorch AdamP vs horovod ContraD vs co-mod-gan AdamP vs sam ContraD vs similarity AdamP vs Adan ContraD vs DETReg AdamP vs OASIS ContraD vs pytorch-CycleGAN-and-pix2pix AdamP vs EasyOCR ContraD vs LinkDist AdamP vs yolov5