For Heads-of · Practitioner

Counterfactual Explanation

An explanation of an automated decision that states the smallest change to the inputs that would have changed the outcome, such as an application that would have been approved with a higher declared income. It tells the affected person what would have made the difference without exposing the model.

  • explainability
  • counterfactuals
  • right to explanation
  • automated decisions

Why it is useful

Most people affected by a decision want to know why, and what would change it, not how the model works. A counterfactual answers both in their terms and supports the right to contest. It needs no access to the model's internals, which makes it practical for third-party and opaque systems. Wachter, Mittelstadt and Russell proposed it in 2017 as a way to meet GDPR transparency without disclosing the algorithm.

Its limits

A counterfactual can point to something the person cannot change, such as age, or to a proxy for a protected characteristic, which reveals discrimination rather than explaining a decision. Several different counterfactuals may be valid, and the one chosen shapes the message. It explains one decision, not the system's overall behaviour.

Where it sits

It is one technique under explainability, alongside feature attribution, and it is what makes contestability practical. The register entry it addresses is inadequate explainability for affected individuals; automated decision-making safeguards is the control.

Sources

Related Terms

Related risks and controls

← Back to Glossary