Skip to content
All papers

Denoising Diffusion Probabilistic Models

Jonathan Ho, Ajay Jain, Pieter Abbeel2020NeurIPS 2020

Read it on arxiv.org(opens in a new tab)

Why this one

A lot of image generation talk sounds mystical because people describe the final samples, not the training problem. The useful idea here is simpler: learn to undo small steps of noise, then chain that denoiser backward until random noise becomes data. What people often get wrong is treating diffusion as just another GAN replacement. The paper is really about turning generation into a supervised prediction problem with a carefully chosen corruption process, which makes training stable and inspectable. If you are building with modern image, video or audio models, this gives you the mental model behind schedulers, sampling steps, guidance and why inference cost grows with every denoising step. It is worth your evening because many later tricks are just changes to this loop.

What to take away

  • Generation is framed as repeatedly predicting and removing Gaussian noise from a corrupted sample.
  • The forward noising process is fixed, so the model only has to learn the reverse denoising transitions.
  • Sample quality and inference cost are tied to how many reverse steps you choose to run.

Reads with