Help me implement this paper expanding on Google's SAM optimizer

This page summarizes the projects mentioned and recommended in the original post on /r/MLQuestions

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • sam

    SAM: Sharpness-Aware Minimization (PyTorch)

  • Here is the code for SAM. SAM isn't too complicated. There are two forward and backward passes, a gradient accent after the first one, and the gradient decent after the second. The gradient accent is to get the noised SAM model which is calculated as for each p in param group add epsilon, which is rho * (p.grad / grad_norm), with rho being SAM's only hyperparameter.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • What is the correct way to sum loss into a total loss and then to backprop?

    1 project | /r/MLQuestions | 24 Nov 2021
  • [R] Sharpness-Aware Minimization for Efficiently Improving Generalization

    1 project | /r/MachineLearning | 30 Apr 2021
  • [R] When Vision Transformers Outperform ResNets without Pretraining or Strong Data Augmentations

    2 projects | /r/MachineLearning | 5 Jun 2021
  • [D]: Implementation: Deconvolutional Paragraph Representation Learning

    1 project | /r/MachineLearning | 25 Apr 2023
  • VQGAN+CLIP : "RAdam" from torch_optimizer could not be imported ?

    2 projects | /r/deepdream | 28 Oct 2021