AdamP
Adan-pytorch
AdamP | Adan-pytorch | |
---|---|---|
1 | 1 | |
409 | 240 | |
1.5% | - | |
0.0 | 3.2 | |
over 3 years ago | over 1 year ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AdamP
-
[R] A theoretical reviewing video on "AdamP: Slowing Down the Slowdown for momentum optimizers (ICLR 2021)"
Paper: https://openreview.net/forum?id=Iz3zU3M316D Code: https://github.com/clovaai/AdamP Project page: https://clovaai.github.io/AdamP/
Adan-pytorch
-
I tried the new adan optimizer..... Promising results(?)
Sometimes, google tries to be useful by recommending stuff like this https://github.com/lucidrains/Adan-pytorch
What are some alternatives?
horovod - Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
Sophia - Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
sam - SAM: Sharpness-Aware Minimization (PyTorch)
torchopt - TorchOpt is an efficient library for differentiable optimization built upon PyTorch.
Adan - Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
OASIS - Official implementation of the paper "You Only Need Adversarial Supervision for Semantic Image Synthesis" (ICLR 2021)
adan-experiments - Checking out the new adan optimizer
EasyOCR - Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
yolov5 - YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
ContraD - Code for the paper "Training GANs with Stronger Augmentations via Contrastive Discriminator" (ICLR 2021)