Week 8

Lecture 9: Neural Networks and Neural Language Models, 11 Oct.

Presentation (updated after class Oct. 11)

Recordings

• First hour: Logistic Regression and SoftMax
• Second hour: Learning skip-gram + neural networks

Mandatory reading

Jurafsky and Martin, Speech and Language Processing, 3. ed. (edition of Sept. 2021!)

• Ch. 6, sec. 6.8 "Word2vec"
• Ch. 7 "Neural Networks and Neural Language Models"

Lab-session, Thursday 14 October at Sed

• Program:
  • 1 hour, Exam 2019, exercise 1
    • The data are at page 12
  • 1 hour Mandatory 2