Academy K

Activation Patching for Circuit Analysis

HardDerivationactivation patchingcircuitsinterpretability

Related module: Alignment fundamentals

Problem statement

Activation patching is a technique for understanding which components contribute to model behavior.

  1. Describe the activation patching methodology.
  2. What is the difference between patching activations and patching attention patterns?
  3. Design an experiment using activation patching to find which attention heads are responsible for copying.

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.