Adan-pytorch

Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch (by lucidrains)

Adan-pytorch Alternatives

Similar projects and alternatives to Adan-pytorch based on common topics and language

  • Sophia

    Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs. (by kyegomez)

  • torchopt

    TorchOpt is an efficient library for differentiable optimization built upon PyTorch.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • adan-experiments

    Discontinued Checking out the new adan optimizer

  • Adan

    Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

  • AdamP

    AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Adan-pytorch alternative or higher similarity.

Adan-pytorch reviews and mentions

Posts with mentions or reviews of Adan-pytorch. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-09-03.

Stats

Basic Adan-pytorch repo stats
1
240
3.2
over 1 year ago

lucidrains/Adan-pytorch is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of Adan-pytorch is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com