Optimizing Neural Networks

In this lecture, we dive deeper (pun intended) into training deep neural networks. We’ll explore key techniques for optimizing their performance.

Learning outcomes:

• Understand Stochastic Gradient Descent (SGD)

• Be familiar with hyperparameter search methods

• Understand learning rate schedulers and their role in training

• Understand adaptive learning algorithms