Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
Why do you think that https://github.com/jettify/pytorch-optimizer is a good alternative to DemonRangerOptimizer