Academy K

The Corrigibility Problem

HardConceptualcorrigibilitycontrolalignment

Related module: Alignment fundamentals

Problem statement

A corrigible AI allows humans to modify or shut it down.

  1. Why might a capable AI resist being shut down even with benign goals?
  2. What is the "utility indifference" approach to corrigibility?
  3. What are the fundamental tensions in achieving corrigibility?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.