Plans for the week of March 31-April 4

Dear all, welcome back and we hope the week has started the best possible way.

First a practical note. Due to a meeting at the MN-faculty at UiO during our lecture time, the lecture this week will be posted as a recording before (most likely before the actual lecture time). This means that there is no in-person or direct zoom session on April 3. We will mail you all when the recording is ready. I am sorry for this. Next week we will have a regular lecture (in-person and direct zoom sessions, the lecture will recorded as usual).

The topic this week is a direct continuation from last week, that is generative models and energy models in particular. We will go through the math (and codes) for making a Boltzmann machine. We will also discuss Gibbs sampling and repeat some of the central topics from last week. The jupyter-notebook this week is somewhat long, but a good part of the initial material is material from last week, meant as a reminder on what we went through. The jupyter-notebook is at https://github.com/CompPhysics/AdvancedMachineLearning/blob/main/doc/pub/week11/ipynb/week11.ipynb and the plans this week are

Plans for the week of March 31-April 4

Generative methods, energy models and Boltzmann machines.

1. Restricted Boltzmann machines, reminder from last week

2. Reminder on Markov Chain Monte Carlo from last week

3. Gibbs sampling

4. Discussions of various Boltzmann machines

5. Implementation of Boltzmann machines using TensorFlow and Pytorch

6. Reading recommendation: Goodfellow et al chapters 18.1-18.2, 20.1-20-7; To create Boltzmann machine using Keras, see Babcock and Bali chapter 4, see https://github.com/PacktPublishing/Hands-On-Generative-AI-with-Python-and-TensorFlow-2/blob/master/Chapter_4/models/rbm.py

7. See also Foster, chapter 7 on energy-based models at https://github.com/davidADSP/Generative_Deep_Learning_2nd_Edition/tree/main/notebooks/07_ebm/01_ebm

To summarize, there is no in-person lecture this week. The lab session will however be run as normal. Both Edvin and I will be there from 215pm-4pm.

Best wishes,

Edvin and Morten