Batch Normalization Mechanics
InterviewDerivationbatch normalizationtrainingoptimization
Related module: Deep learning fundamentals
Problem statement
Batch normalization normalizes activations during training.
- Write the batch normalization forward pass equations.
- How does batch normalization affect the gradient flow?
- Why does batch normalization improve training, and what are alternative explanations?