D-Adaptation for SGD, Adam and AdaGrad
Why do you think that https://github.com/sail-sg/Adan is a good alternative to dadaptation
D-Adaptation for SGD, Adam and AdaGrad
Why do you think that https://github.com/sail-sg/Adan is a good alternative to dadaptation