Transcript
![Page 1: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/1.jpg)
Lecture 9 - scribblesTuesday, October 2, 2018 14:31
IFT6269 Page 1
![Page 2: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/2.jpg)
IFT6269 Page 2
![Page 3: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/3.jpg)
IFT6269 Page 3
![Page 4: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/4.jpg)
IFT6269 Page 4
![Page 5: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/5.jpg)
some references:
for convex optimization: Boyd & Vandenberghe's book ○
DL book -- chapter 4.3 on gradient-based optimization○
Matrix Differential Calculus with Applications in Statistics and Econometrics, Heinz Neudecker and Jan R. Magnus -- free online
for matrix calculus: ○
IFT6269 Page 5
![Page 6: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/6.jpg)
online
IFT6269 Page 6
![Page 7: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/7.jpg)
IFT6269 Page 7
![Page 8: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/8.jpg)
IFT6269 Page 8
![Page 9: Lecture 9 - scribblesslacoste/teaching/ift6269/A19/notes/lecture9... · Lecture 9 - scribbles Tuesday, October 2, 2018 14:31 IFT6269 Page 1 . IFT6269 Page 2 . IFT6269 Page 3 . IFT6269](https://reader033.vdocument.in/reader033/viewer/2022043022/5f3e2921a64e076adb6aefd4/html5/thumbnails/9.jpg)
IFT6269 Page 9