Value Learning Problems
InterviewConceptualvalue learningalignmentpreferences
Related module: Alignment fundamentals
Problem statement
Value learning aims to infer human values from behavior and feedback.
- What is the "easy problem" vs "hard problem" of value learning?
- Explain three challenges specific to learning human values.
- What is "value lock-in" and why is it concerning?