Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 9 Optimizer Open-Source Projects
-
nn
🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
-
lion-pytorch
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
Various people are trying LiON on their projects, with varying degrees of success. A good starting point to look around is the lion-pytorch on github from Phil Wang aka lucidrains (thank you man!).
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Project mention: Would like some guidance on my learning for fine-tuned model applications (AI related) using Nx / Elixir | /r/elixir | 2023-06-30
My recommendation is to start with fast.ai to understand the machine learning part. Then, for the elixir bit, look at some of the notebooks in the Axon (elixir's NN library) github. I wrote a couple notebooks explaining how to train a basic NN using Axon. Here's one
-
-
Gradient-Centralization-TensorFlow
Instantly improve your training performance of TensorFlow models with just 2 lines of code!
-
DL4S
Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
dnn_from_scratch
A high level deep learning library for Convolutional Neural Networks,GANs and more, made from scratch(numpy/cupy implementation).
-
Optimizers related posts
- Applying All Recent Innovations To Train a Code Model
- AMD RoCM Dockerfiles
- Building an ML model using Axon and Livebook
- Recognize Digits Using ML in Elixir
- [P] Axon: Deep Learning in Elixir
- ML Optimizers from scratch using JAX
- [P] Implementation of MADGRAD optimization algorithm for Tensorflow
-
A note from our sponsor - InfluxDB
www.influxdata.com | 29 Mar 2024
Index
What are some of the best open-source Optimizer projects? This list will help you:
Project | Stars | |
---|---|---|
1 | nn | 46,249 |
2 | lion-pytorch | 1,889 |
3 | axon | 1,432 |
4 | opytimizer | 588 |
5 | Gradient-Centralization-TensorFlow | 105 |
6 | DL4S | 100 |
7 | ML-Optimizers-JAX | 40 |
8 | dnn_from_scratch | 29 |
9 | flaxOptimizers | 28 |