Jailbreak Attacks on LLMs
InterviewConceptualsafetyadversarialred-teaming
Related module: Agents and tool use
Problem statement
Jailbreak attacks attempt to bypass LLM safety training.
- Describe three categories of jailbreak attacks.
- Why is defending against jailbreaks fundamentally difficult?
- How would you design a red-teaming process for a production LLM?