Our great sponsors
-
ContraD
Code for the paper "Training GANs with Stronger Augmentations via Contrastive Discriminator" (ICLR 2021)
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Well, I've been trying to train a 1024 GAN from scratch on stylegan2-ada-pytorch with a small dataset 300 samples of not so diversity in images of painting faces. Fact is that on first try FID went as low as 71 and started deteriorating. Now I x-flip augmented the dataset (700 images) and at 900kimg FID went 64 but I doubt it will get lower. I lowered the learning rate to 0.0001 as they say it might help... Recently found this way of dataset augmentation... probably will use this https://github.com/jh-jeong/ContraD
Authors of the StyleGAN2-ada already try many things in this paper, I suggest you check it out: https://arxiv.org/abs/2006.06676. You can just check sections 4.2 and 4.3.
Related posts
- To the people who use SD to apply different styles to videos
- [D] A better way to compute the Fréchet Inception Distance (FID)
- Another CN test! Sorry for the swedish!
- [D] Are there any good FID and KID metrics implementations existing that are compatible with pytorch?
- InstructPix2Pix Video: "Turn the wave into trash"