Constitutional AI Principles
InterviewConceptualalignmentConstitutional AIsafety
Related module: Post-training and alignment methods
Problem statement
Constitutional AI (CAI) uses AI feedback guided by principles instead of human labels.
- How does CAI differ from standard RLHF?
- What is the critique-revision process?
- What are the advantages and limitations of this approach?