Learn how to use the idea of Momentum to accelerate Gradient Descent.
----------------
References:
Lectures on Convex Optimization by Yuri Nesterov: link.springer.com/book/10.1007/978-3-319-91578-4
Convex Optimization: Algorithms and Complexity by Sébastien Bubeck: arxiv.org/pdf/1405.4980.pdf
MIT Lecture by Gilbert Strang: • 23. Accelerating Gradient Descent (Use Mom...
--------------
Timestamps:
0:00 Intro
1:00 Momentum Gradient Descent
1:44 Nesterov's Accelerated Gradient Descent
2:23 First Interpretation
2:35 Second Interpretation
---------------
Credit:
🐍 Manim and Python : github.com/3b1b/manim
🐵 Blender3D: www.blender.org/
🗒️ Emacs: www.gnu.org/software/emacs/
Music: www.bensound.com
This video would not have been possible without the help of Gökçe Dayanık
コメント