Academy K

Mesa-Optimization and Inner Alignment

HardConceptualmesa-optimizationinner alignmentdeception

Related module: Alignment fundamentals

Problem statement

A mesa-optimizer is a learned model that itself performs optimization.

  1. Distinguish between base optimizer, mesa-optimizer, base objective, and mesa-objective.
  2. Under what conditions might mesa-objectives diverge from base objectives?
  3. What is "deceptive alignment" and why is it a concern?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.