Emergent Abilities in Language Models
HardConceptualemergencescalingcapabilities
Related module: Superintelligence and safety
Problem statement
Some capabilities appear to "emerge" suddenly at certain model scales.
- What is the definition of an emergent ability?
- Give examples of purported emergent abilities.
- What is the debate about whether emergence is real or an artifact?