ML-Optimizers-JAX
dnn_from_scratch
Our great sponsors
ML-Optimizers-JAX | dnn_from_scratch | |
---|---|---|
1 | 1 | |
40 | 29 | |
- | - | |
4.5 | 0.0 | |
almost 3 years ago | almost 3 years ago | |
Python | Python | |
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ML-Optimizers-JAX
-
ML Optimizers from scratch using JAX
Github link (includes a link to a Kaggle notebook to run it directly) - shreyansh26/ML-Optimizers-JAX
dnn_from_scratch
What are some alternatives?
RAdam - On the Variance of the Adaptive Learning Rate and Beyond
deepxde - A library for scientific machine learning and physics-informed learning
DemonRangerOptimizer - Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
HyperGAN - Composable GAN framework with api and user interface
dm-haiku - JAX-based neural network library
ALAE - [CVPR2020] Adversarial Latent Autoencoders
trax - Trax — Deep Learning with Clear Code and Speed
guesslang - Detect the programming language of a source code
AdasOptimizer - ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance
open-lpr - Open Source and Free License Plate Recognition Software
flaxOptimizers - A collection of optimizers, some arcane others well known, for Flax.
Mask-RCNN-TF2 - Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow 2.0