Cutting-Edge Gradient Descent Variants With Levente Szabados

Content provided by Miklos Toth and Miklos Zoltan Toth. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Miklos Toth and Miklos Zoltan Toth or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Machine Learning Cafe « »
Cutting-Edge Gradient Descent Variants with Levente Szabados - 004

5y ago 36:40

MP3•Episode home

In this episode, we are focusing on Deep Learning Optimizers, the different Gradient Descent Variants from vanilla GD to RAdam and Ranger. Levente tells us the story of GD from the simplest ones to the newest ones. This is part 1.

Levente's Linkedin URL: https://www.linkedin.com/in/levente-szabados-76334728/

An overview of gradient descent optimization algorithms: https://arxiv.org/pdf/1609.04747.pdf

Lookahead optimizer algorithm: https://arxiv.org/pdf/1907.08610.pdf

Ranger optimizer by Less Wright: https://medium.com/@lessw/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d

---Copyright Info--- Music is from https://filmmusic.io, intro first part is by Miklos Toth and some free garage band loops. :) intro second part: "Aces High" by Kevin MacLeod, outro "Acid Trumpet" by Kevin MacLeod (https://incompetech.com), License: CC BY (http://creativecommons.org/licenses/by/4.0/)

16 episodes

#Science #Math #Entrepreneur #Business #Miklos Toth #Miklos Zoltan Toth #Datascience #Deeplearning #Machinelearning #Neuralnetworks