Academy K

Value Learning Problems

InterviewConceptualvalue learningalignmentpreferences

Related module: Alignment fundamentals

Problem statement

Value learning aims to infer human values from behavior and feedback.

  1. What is the "easy problem" vs "hard problem" of value learning?
  2. Explain three challenges specific to learning human values.
  3. What is "value lock-in" and why is it concerning?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.