Academy K

Neural Network Interpretability Techniques

InterviewConceptualinterpretabilityfeaturescircuits

Related module: Alignment fundamentals

Problem statement

Interpretability aims to understand what neural networks have learned.

  1. Distinguish between mechanistic interpretability and behavioral interpretability.
  2. Describe three techniques for understanding what features neurons detect.
  3. What is a "circuit" in the mechanistic interpretability sense?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.