opytimizer
lion-pytorch
| opytimizer | lion-pytorch | |
|---|---|---|
| 7 | 3 | |
| 594 | 1,925 | |
| - | - | |
| 5.5 | 3.8 | |
| 5 months ago | about 1 month ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
opytimizer
-
[P] Opytimizer: A Nature-Inspired Python Optimizer
We do have a Simulated Annealing version designed to work with the library's structure: https://github.com/gugarosa/opytimizer/blob/master/opytimizer/optimizers/science/sa.py
-
Opytimizer: A Nature-Inspired Python Optimizer
Opytimizer: A Nature-Inspired Python Optimizer
Thanks mate! That would be a great addition indeed. We do have some examples over https://github.com/gugarosa/opytimizer/tree/master/examples/..., but they are not clearly depicted as the README would be. Thanks a lot!!
-
Gradient-Free-Optimizers A collection of modern optimization methods in Python
There's also Opytimizer [0] for almost every metaheuristic optimization algorithm under the Sun.
[0] https://github.com/gugarosa/opytimizer
lion-pytorch
-
Applying All Recent Innovations To Train a Code Model
Various people are trying LiON on their projects, with varying degrees of success. A good starting point to look around is the lion-pytorch on github from Phil Wang aka lucidrains (thank you man!).
- AMD RoCM Dockerfiles
-
[D] Lion , An Optimizer That Outperforms Adam - Symbolic Discovery of Optimization Algorithms
Code Implementation: https://github.com/lucidrains/lion-pytorch
What are some alternatives?
BayesianOptimization - A Python implementation of global optimization with gaussian processes.
llm-foundry - LLM training code for Databricks foundation models
Hyperactive - An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.
dnn_from_scratch - A high level deep learning library for Convolutional Neural Networks,GANs and more, made from scratch(numpy/cupy implementation).
optimization-tutorial - Tutorials for the optimization techniques used in Gradient-Free-Optimizers and Hyperactive.
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
Gradient-Free-Optimizers - Simple and reliable optimization with local, global, population-based and sequential techniques in numerical discrete search spaces.
Gradient-Centralization-TensorFlow - Instantly improve your training performance of TensorFlow models with just 2 lines of code!
sqpdfo - Sequential-Quadratic-Programming Derivative-Free Optimization
RoCMyDocker - A collection of Dockerfiles tailored for Deep Learning and other GPU-accelerated applications on AMD Radeon GPUs using ROCm
flaxOptimizers - A collection of optimizers, some arcane others well known, for Flax.
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python