[R] Sharpness-Aware Minimization for Efficiently Improving Generalization

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning
Optimizer Pytorch Sam sharpness-aware

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • sam

    SAM: Sharpness-Aware Minimization (PyTorch)

    • They reached sota on a few tasks. Do you really believe that the entire community missed the magic hyperparameters of batch size 128 and Adam to beat SOTA? I think getting SOTA really solidifies the approach, albeit the 2x speed cost seems heavy. As for implementation, it looks fairly trivial to adapt to all optimizers, at least from this random github https://github.com/davda54/sam

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • What is the correct way to sum loss into a total loss and then to backprop?

    1 project | /r/MLQuestions | 24 Nov 2021

  • Help me implement this paper expanding on Google's SAM optimizer

    1 project | /r/MLQuestions | 12 Apr 2021

  • [R] When Vision Transformers Outperform ResNets without Pretraining or Strong Data Augmentations

    2 projects | /r/MachineLearning | 5 Jun 2021

  • [D]: Implementation: Deconvolutional Paragraph Representation Learning

    1 project | /r/MachineLearning | 25 Apr 2023

  • VQGAN+CLIP : "RAdam" from torch_optimizer could not be imported ?

    2 projects | /r/deepdream | 28 Oct 2021