Moyan AI Training Institution LogoMoyan AI

Ethics · Established · Beginner

Bias in AI

Systematic unfairness in AI outputs that disadvantages particular groups, usually inherited from data or design choices.

What Bias in AI is

Bias enters through unrepresentative training data, historical inequities encoded in labels, proxy variables that stand in for protected attributes, and evaluation that only reports aggregate accuracy.

How it works

Mitigation means measuring performance by subgroup, auditing data representation, testing with counterfactual inputs, applying fairness constraints, and documenting known limitations. There is no single fairness definition that satisfies all criteria simultaneously.

Why it matters

Biased systems in hiring, lending, policing and healthcare cause concrete harm and increasingly attract legal liability.

Common uses

  • Fairness audits
  • Subgroup performance reporting
  • Model documentation

Watch for

  • Fairness definitions conflict mathematically
  • Protected attributes often unavailable for measurement

Continue exploring

More in this collection

Browse all AI Concepts