Moyan AI Training Institution LogoMoyan AI

Practice · Established · Intermediate

Cross-Validation

Estimating model performance by repeatedly training and testing on different partitions of the data.

What Cross-Validation is

Rather than trusting a single train-test split, cross-validation rotates the held-out fold so every record is evaluated once, giving a mean and a variance for the score.

How it works

k-fold splits the data into k parts; stratified variants preserve class balance; time-series validation only ever tests on later periods. All preprocessing must be fitted inside each fold.

Why it matters

It makes small-data results trustworthy and exposes unstable models that a lucky split would hide.

Common uses

  • Hyperparameter search
  • Model comparison
  • Small dataset evaluation

Strengths

  • More reliable estimates
  • Reveals variance across folds

Watch for

  • k times the training cost
  • Invalid on time-dependent data if done naively

Continue exploring

More in this collection

Browse all AI Concepts