flaxOptimizers
Gradient-Centralization-TensorFlow
| flaxOptimizers | Gradient-Centralization-TensorFlow | |
|---|---|---|
| 1 | 5 | |
| 28 | 105 | |
| - | - | |
| 0.0 | 0.0 | |
| over 2 years ago | about 2 years ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flaxOptimizers
-
[P] Implementation of MADGRAD optimization algorithm for Tensorflow
For those who are interested, I have a Flax implementation of MADGRAD in flaxOptimizers (here). The optimizer solid and a refreshing departure from Adam-derived optimizers. One big caveat, however, is that you will need to tune your hyperparameters as they are likely to be orders of magnitude different from Adam's value.
Gradient-Centralization-TensorFlow
- How many epochs of constant loss (e.g. 0.6933) will cause you to try something else?
- A Python package to boost your ML training performance
- A Python package to sizably boost your ML performance
-
[P] I made gctf: a package to sizeably improve your performance (link in comments)
GitHub repo: https://github.com/Rishit-dagli/Gradient-Centralization-TensorFlow
- A Python package to sizably increase your ML Training performance
What are some alternatives?
ML-Optimizers-JAX - Toy implementations of some popular ML optimizers using Python/JAX
guesslang - Detect the programming language of a source code
opytimizer - 🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.
DemonRangerOptimizer - Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
EasyMSE - A Python package for generating custom Magic The Gathering cards
Im2txt - Image captioning ready-to-go inference: show and tell model compatible with Tensorflow r1.9
neural-network-scratch - build a neural network to show as a demonstration on inner workings of a neural network
yolo-tf2 - yolo(all versions) implementation in keras and tensorflow 2.x
Machine-Learning-Collection - A resource for learning about Machine learning & Deep Learning
You-Python - A python library for you.com and all of its apps.
EmoPy - A deep neural net toolkit for emotion analysis via Facial Expression Recognition (FER)
pprintex - python pretty printer, unlinke pprint it prints out all object field values.