Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
Why do you think that https://github.com/Liuhong99/Sophia is a good alternative to Sophia
Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
Why do you think that https://github.com/Liuhong99/Sophia is a good alternative to Sophia