Our great sponsors
-
score_sde
Official code for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
You can see the 200 lines code here: https://nn.labml.ai/diffusion/ddpm/index.html and https://github.com/cloneofsimo/minDiffusion, math is here: https://lilianweng.github.io/posts/2021-07-11-diffusion-models/
Turns out that diffusion models also define a certain differential equation, making it a neural ODE. Then you can just integrate the ODE in the other direction to get the exact inverse for the DDPM (it's not entirely exact b/c of numerical error in the solver, but close enough)