Plans for week 47, November 18-22
Dear all, we hope your weekend has been an excellent and relaxing one. Here are our plans for the second last week (our last lecture is November 25):
Lab sessions on Tuesday and Wednesday.
-
Work and Discussion of project 3
-
Second last weekly exercise, see the attached exercise set or go to https://github.com/CompPhysics/MachineLearning/blob/master/doc/LectureNotes/exercisesweek47.ipynb
Plans for the lecture Monday 18 November, with video suggestions etc.
- Basics of decision trees, classification and regression algorithms and ensemble models such as bagging, random forests and gradient boosting. The lecture will include a reminder on decision trees from last week.
- Readings and Videos:
a. Week 47 lecture notes at https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week47/ipynb/week47.ipynb
b. See also lecture notes from week 46 at https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week46/ipynb/week46.ipynb. The lecture on Monday starts with a repetition on how to make a decision tree.
c. Video on Decision trees https://www.youtube.com/watch?v=RmajweUFKvM&ab_channel=Simplilearn
d. Video on boosting methods https://www.youtube.com/watch?v=wPqtzj5VZus&ab_channel=H2O.ai
e. Video on AdaBoost https://www.youtube.com/watch?v=LsK-xG1cLYA
f. Video on Gradient boost, part 1, parts 2-4 follow thereafter https://www.youtube.com/watch?v=3CC4N4z3GJc
g. Decision Trees: Rashcka et al chapter 3 pages 86-98, and chapter 7 on Ensemble methods, Voting and Bagging and Gradient Boosting. See also lecture from STK-IN4300, lecture 7 at /studier/emner/matnat/math/STK-IN4300/h20/slides/lecture_7.pdf.
We are aiming at coming with the feedback on project 2 during the last week of the semester, week 48 (next week).
Best wishes to you all.
Fahimeh, Ida, Karl Henrik, Mia, Morten, Odin and Sigurd