Dear all, welcome back to FYS5429/9429. We hope the week has started the best possible way for you all.
This week we start with recurrent neural networks, with a basic overview and their math. Note that the jupyter-notebook for this week, will be updated with more material (basic math of RNNs) the next two days.
We will continue with RNNs next week as well, and discuss how we can encode them, plus more on their math.
For those of you interested in say large language models, RNNs served as prototypes and could represent a full semester project, like the CNN coding project.
Plans for the week February 24-28, 2025
Intro to and mathematics of Recurrent Neural Networks (RNNs)
More material will be added (Tuesday and Wednesday this week).
Reading recommendations
For RNNs, see Goodfellow et al chapter 10, see https://www.deeplearningbook.org/contents/rnn.html. This book g...