Backpropagation Through a Network
InterviewDerivationbackpropagationchain rulegradients
Related module: Learning from data and backpropagation
Problem statement
Consider a two-layer neural network:
where is an element-wise activation and is the target.
Derive the gradients , , , and .
Hints