flaxOptimizers
dnn_from_scratch
flaxOptimizers | dnn_from_scratch | |
---|---|---|
1 | 1 | |
28 | 29 | |
- | - | |
0.0 | 0.0 | |
over 2 years ago | almost 3 years ago | |
Python | Python | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flaxOptimizers
-
[P] Implementation of MADGRAD optimization algorithm for Tensorflow
For those who are interested, I have a Flax implementation of MADGRAD in flaxOptimizers (here). The optimizer solid and a refreshing departure from Adam-derived optimizers. One big caveat, however, is that you will need to tune your hyperparameters as they are likely to be orders of magnitude different from Adam's value.
dnn_from_scratch
What are some alternatives?
ML-Optimizers-JAX - Toy implementations of some popular ML optimizers using Python/JAX
deepxde - A library for scientific machine learning and physics-informed learning
opytimizer - 🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.
HyperGAN - Composable GAN framework with api and user interface
ALAE - [CVPR2020] Adversarial Latent Autoencoders
guesslang - Detect the programming language of a source code
open-lpr - Open Source and Free License Plate Recognition Software
Mask-RCNN-TF2 - Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow 2.0
t81_558_deep_learning - T81-558: Keras - Applications of Deep Neural Networks @Washington University in St. Louis
gan-vae-pretrained-pytorch - Pretrained GANs + VAEs + classifiers for MNIST/CIFAR in pytorch.
the-gan-zoo - A list of all named GANs!
cnn-in-welding - Detecting Faults and Measuring Severity in Welding using Radiographic Images