opytimizer
flaxOptimizers
opytimizer | flaxOptimizers | |
---|---|---|
7 | 1 | |
594 | 29 | |
- | - | |
5.5 | 0.0 | |
5 months ago | almost 3 years ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
opytimizer
-
[P] Opytimizer: A Nature-Inspired Python Optimizer
We do have a Simulated Annealing version designed to work with the library's structure: https://github.com/gugarosa/opytimizer/blob/master/opytimizer/optimizers/science/sa.py
-
Opytimizer: A Nature-Inspired Python Optimizer
Opytimizer: A Nature-Inspired Python Optimizer
Thanks mate! That would be a great addition indeed. We do have some examples over https://github.com/gugarosa/opytimizer/tree/master/examples/..., but they are not clearly depicted as the README would be. Thanks a lot!!
-
Gradient-Free-Optimizers A collection of modern optimization methods in Python
There's also Opytimizer [0] for almost every metaheuristic optimization algorithm under the Sun.
[0] https://github.com/gugarosa/opytimizer
flaxOptimizers
-
[P] Implementation of MADGRAD optimization algorithm for Tensorflow
For those who are interested, I have a Flax implementation of MADGRAD in flaxOptimizers (here). The optimizer solid and a refreshing departure from Adam-derived optimizers. One big caveat, however, is that you will need to tune your hyperparameters as they are likely to be orders of magnitude different from Adam's value.
What are some alternatives?
BayesianOptimization - A Python implementation of global optimization with gaussian processes.
ML-Optimizers-JAX - Toy implementations of some popular ML optimizers using Python/JAX
Hyperactive - An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.
optimization-tutorial - Tutorials for the optimization techniques used in Gradient-Free-Optimizers and Hyperactive.
Gradient-Free-Optimizers - Simple and reliable optimization with local, global, population-based and sequential techniques in numerical discrete search spaces.
sqpdfo - Sequential-Quadratic-Programming Derivative-Free Optimization
lion-pytorch - 🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
surrogate-models - A collection of surrogate models for sequence model based optimization techniques
pybobyqa - Python-based Derivative-Free Optimization with Bound Constraints