Foundations · Fast-moving · Advanced
Emergent Abilities
Capabilities that appear only above a certain model scale and are largely absent in smaller models.
What Emergent Abilities is
Examples cited include multi-step arithmetic and some forms of in-context reasoning. Later work argued several apparent jumps are artefacts of discontinuous metrics rather than genuine phase changes.
How it works
Researchers plot task performance against scale; sharp discontinuities suggest emergence, while smooth curves under continuous metrics suggest gradual improvement.
Why it matters
The debate matters for forecasting: if capabilities appear abruptly, safety evaluation must anticipate them before release.
Common uses
- →Capability forecasting
- →Pre-deployment evaluation design
Watch for
- ✓Definition depends on the metric chosen
- ✓Contested in the literature
Continue exploring
More in this collection
Browse all AI Concepts