Academy K

Batch Normalization Mechanics

InterviewDerivationbatch normalizationtrainingoptimization

Related module: Deep learning fundamentals

Problem statement

Batch normalization normalizes activations during training.

  1. Write the batch normalization forward pass equations.
  2. How does batch normalization affect the gradient flow?
  3. Why does batch normalization improve training, and what are alternative explanations?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.