Capability Elicitation and Sandbagging
InterviewConceptualcapabilitiesevaluationdeception
Related module: Alignment fundamentals
Problem statement
Capability elicitation is the problem of determining what a model can actually do.
- Why might standard evaluations underestimate model capabilities?
- What is "sandbagging" and why is it concerning?
- How can evaluators improve capability elicitation?