Academy K

Emergent Abilities in Language Models

HardConceptualemergencescalingcapabilities

Related module: Superintelligence and safety

Problem statement

Some capabilities appear to "emerge" suddenly at certain model scales.

  1. What is the definition of an emergent ability?
  2. Give examples of purported emergent abilities.
  3. What is the debate about whether emergence is real or an artifact?

Practise this problem

Verify you understand it—not just that you read the answer.

Learn the foundations

The AI / SI track covers this topic and more in depth.