Courage to Learn ML: Tackling Vanishing and Exploding Gradients (Part 1) | Towards Data Science

In the last installment of the ‘Courage to Learn ML‘ series, our learner and mentor focus on learning two essential theories of DNN training, gradient descent and backpropagation. Their...

By · · 1 min read
Courage to Learn ML: Tackling Vanishing and Exploding Gradients (Part 1) | Towards Data Science

Source: Towards Data Science

In the last installment of the ‘Courage to Learn ML‘ series, our learner and mentor focus on learning two essential theories of DNN training, gradient descent and backpropagation. Their journey began with a look at how gradient descent is pivotal in minimizing the loss function. Curious about the complexities of computing gradients in deep neural […]