Moyan AI Training Institution LogoMoyan AI

Foundations · Fast-moving · Advanced

Emergent Abilities

Capabilities that appear only above a certain model scale and are largely absent in smaller models.

What Emergent Abilities is

Examples cited include multi-step arithmetic and some forms of in-context reasoning. Later work argued several apparent jumps are artefacts of discontinuous metrics rather than genuine phase changes.

How it works

Researchers plot task performance against scale; sharp discontinuities suggest emergence, while smooth curves under continuous metrics suggest gradual improvement.

Why it matters

The debate matters for forecasting: if capabilities appear abruptly, safety evaluation must anticipate them before release.

Common uses

  • Capability forecasting
  • Pre-deployment evaluation design

Watch for

  • Definition depends on the metric chosen
  • Contested in the literature

Continue exploring

More in this collection

Browse all AI Concepts