Optimizers

Top 9 Optimizer Open-Source Projects

  • nn

    🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

  • lion-pytorch

    🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

    Project mention: Applying All Recent Innovations To Train a Code Model | dev.to | 2023-08-11

    Various people are trying LiON on their projects, with varying degrees of success. A good starting point to look around is the lion-pytorch on github from Phil Wang aka lucidrains (thank you man!).

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • axon

    Nx-powered Neural Networks

    Project mention: Would like some guidance on my learning for fine-tuned model applications (AI related) using Nx / Elixir | /r/elixir | 2023-06-30

    My recommendation is to start with fast.ai to understand the machine learning part. Then, for the elixir bit, look at some of the notebooks in the Axon (elixir's NN library) github. I wrote a couple notebooks explaining how to train a basic NN using Axon. Here's one

  • opytimizer

    🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.

  • Gradient-Centralization-TensorFlow

    Instantly improve your training performance of TensorFlow models with just 2 lines of code!

  • DL4S

    Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux

  • ML-Optimizers-JAX

    Toy implementations of some popular ML optimizers using Python/JAX

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • dnn_from_scratch

    A high level deep learning library for Convolutional Neural Networks,GANs and more, made from scratch(numpy/cupy implementation).

  • flaxOptimizers

    A collection of optimizers, some arcane others well known, for Flax.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-08-11.

Optimizers related posts

Index

What are some of the best open-source Optimizer projects? This list will help you:

Project Stars
1 nn 46,249
2 lion-pytorch 1,889
3 axon 1,432
4 opytimizer 588
5 Gradient-Centralization-TensorFlow 105
6 DL4S 100
7 ML-Optimizers-JAX 40
8 dnn_from_scratch 29
9 flaxOptimizers 28
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com