AdamP
ContraD
AdamP | ContraD | |
---|---|---|
1 | 1 | |
409 | 189 | |
1.5% | - | |
0.0 | 0.0 | |
over 3 years ago | over 2 years ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AdamP
-
[R] A theoretical reviewing video on "AdamP: Slowing Down the Slowdown for momentum optimizers (ICLR 2021)"
Paper: https://openreview.net/forum?id=Iz3zU3M316D Code: https://github.com/clovaai/AdamP Project page: https://clovaai.github.io/AdamP/
ContraD
-
[D] What is the smallest dataset you styleGAN2 trained?
Well, I've been trying to train a 1024 GAN from scratch on stylegan2-ada-pytorch with a small dataset 300 samples of not so diversity in images of painting faces. Fact is that on first try FID went as low as 71 and started deteriorating. Now I x-flip augmented the dataset (700 images) and at 900kimg FID went 64 but I doubt it will get lower. I lowered the learning rate to 0.0001 as they say it might help... Recently found this way of dataset augmentation... probably will use this https://github.com/jh-jeong/ContraD
What are some alternatives?
horovod - Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
stylegan2-ada-pytorch - StyleGAN2-ADA - Official PyTorch implementation
sam - SAM: Sharpness-Aware Minimization (PyTorch)
co-mod-gan - [ICLR 2021, Spotlight] Large Scale Image Completion via Co-Modulated Generative Adversarial Networks
Adan - Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
similarity - TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
OASIS - Official implementation of the paper "You Only Need Adversarial Supervision for Semantic Image Synthesis" (ICLR 2021)
DETReg - Official implementation of the CVPR 2022 paper "DETReg: Unsupervised Pretraining with Region Priors for Object Detection".
EasyOCR - Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
pytorch-CycleGAN-and-pix2pix - Image-to-Image Translation in PyTorch
yolov5 - YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
LinkDist - Distillation Self-Knowledge From Contrastive Links to Classify Graph Nodes Without Passing Messages.