Plans for the week of May 6-10
Dear all, welcome back to our second last session this semester. Note the following: the lecture this Tuesday is digital (zoom) only since I (Morten) am in the US May 5-11 for a short research stay.
Furthermore, since our original time 1015am-12pm means 315am-5am in the night for me, I would like to ask if we can move the live zoom session to 1.15pm-3pm Oslo time. I hope this works, if not, you can always watch the recording which I will upload right afterwards.
The plan for this week is to wrap up our discussions of Generative models. The emphasis is on
-
Finalizing discussion of Generative Adversarial Networks
-
Mathematics of diffusion models and selected examples.
Reading on diffusion models.
-
A central paper is the one by Sohl-Dickstein et al, Deep Unsupervised Learning using Non-equilibrium Thermodynamics, https://arxiv.org/abs/1503.03585
-
See also Diederik P. Kingma, Tim Salimans, Ben Poole, Jonathan Ho, Variational Diffusion Models, https://arxiv.org/abs/2107.00630
These two papers are some of the central ones behind the extremely popular diffusion models.
We may most likely have a final session next week where we summarize the course. However, due to a workshop on Machine Learning May 14-16, I would like to suggest that we shift the session on Tuesday May 14 to Monday May 13 at 10.15am-12pm. If it does not fit, you can also watch the recording of the last session. It depends however on how far we get tomorrow.
The weekly material (additions will come later on diffusion models) is at https://github.com/CompPhysics/AdvancedMachineLearning/blob/main/doc/pub/week16/ipynb/week16.ipynb
Best wishes for the week and don't hesitate to contact us. The lab this Thursday is cancelled due to a public holiday in Norway.
Keran, Morten and Ruben