What is the correct way to sum loss into a total loss and then to backprop?

This page summarizes the projects mentioned and recommended in the original post on /r/MLQuestions
Optimizer Pytorch Sam sharpness-aware

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • sam

    SAM: Sharpness-Aware Minimization (PyTorch)

    • Which from here I understand that I shouldn't use the same loss variable for both forward passes but I'm not sure how else to do this. I thought that I could maybe create a variable called total_loss and add the loss to it and then after the iterations to backprop over it, but I'm not sure if that's the correct approach.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • [R] Sharpness-Aware Minimization for Efficiently Improving Generalization

    1 project | /r/MachineLearning | 30 Apr 2021

  • Help me implement this paper expanding on Google's SAM optimizer

    1 project | /r/MLQuestions | 12 Apr 2021

  • [R] When Vision Transformers Outperform ResNets without Pretraining or Strong Data Augmentations

    2 projects | /r/MachineLearning | 5 Jun 2021

  • [D]: Implementation: Deconvolutional Paragraph Representation Learning

    1 project | /r/MachineLearning | 25 Apr 2023

  • VQGAN+CLIP : "RAdam" from torch_optimizer could not be imported ?

    2 projects | /r/deepdream | 28 Oct 2021