Mesa-Optimization and Inner Alignment
HardConceptualmesa-optimizationinner alignmentdeception
Related module: Alignment fundamentals
Problem statement
A mesa-optimizer is a learned model that itself performs optimization.
- Distinguish between base optimizer, mesa-optimizer, base objective, and mesa-objective.
- Under what conditions might mesa-objectives diverge from base objectives?
- What is "deceptive alignment" and why is it a concern?