Lesson 05 of 06 · about 5 min

One gradient

  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6

Backprop is the chain rule. The loss sees the output, the output sees the weight, and the product of those two slopes is the gradient of the loss in the weight.

y = w times x, with w = 3 and x = 2. The target is 4. The loss is one half the squared error. Enter the gradient with respect to w.

On the Knowledge page

Resources