lion-pytorch
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch (by lucidrains)
Gradient-Centralization-TensorFlow
Instantly improve your training performance of TensorFlow models with just 2 lines of code! (by Rishit-dagli)
| lion-pytorch | Gradient-Centralization-TensorFlow | |
|---|---|---|
| 3 | 5 | |
| 1,925 | 106 | |
| - | - | |
| 3.8 | 0.0 | |
| about 2 months ago | over 2 years ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lion-pytorch
Posts with mentions or reviews of lion-pytorch.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-08-11.
-
Applying All Recent Innovations To Train a Code Model
Various people are trying LiON on their projects, with varying degrees of success. A good starting point to look around is the lion-pytorch on github from Phil Wang aka lucidrains (thank you man!).
- AMD RoCM Dockerfiles
-
[D] Lion , An Optimizer That Outperforms Adam - Symbolic Discovery of Optimization Algorithms
Code Implementation: https://github.com/lucidrains/lion-pytorch
Gradient-Centralization-TensorFlow
Posts with mentions or reviews of Gradient-Centralization-TensorFlow.
We have used some of these posts to build our list of alternatives
and similar projects.
- How many epochs of constant loss (e.g. 0.6933) will cause you to try something else?
- A Python package to boost your ML training performance
- A Python package to sizably boost your ML performance
-
[P] I made gctf: a package to sizeably improve your performance (link in comments)
GitHub repo: https://github.com/Rishit-dagli/Gradient-Centralization-TensorFlow
- A Python package to sizably increase your ML Training performance
What are some alternatives?
When comparing lion-pytorch and Gradient-Centralization-TensorFlow you can also consider the following projects:
llm-foundry - LLM training code for Databricks foundation models
guesslang - Detect the programming language of a source code