8. Towards Deep Learning Models#

In this lecture we will dive deeper (pun intended) into non-shallow neural network optimization techniques. We will cover the following:

  • What is Stochastic Gradient Descent?

  • What are Adaptative Learning Rates?

  • How to find the best hyperparameters?

  • How to build and train a neural network?