Control · C-045 · Model & System Lifecycle

Staged rollout

New AI systems and material changes are released first to a limited population under close monitoring, and extended only when defined criteria are met.

Control type
Preventive
Risks addressed
4
Audience
Practitioner
Frameworks
Annex A.6 · MANAGE 2
Reviewed
2026-11-10

What it does

It limits how many people a fault can reach, and tests the system against real use before full reliance. Because no test anticipates everything real users do, the first weeks of production are treated as part of assurance. The system owner decides each expansion; engineering operates the mechanism at every new release and material change.

How to implement it

  • Start with a small share of traffic, a single team or a pilot group.
  • Run the new system alongside the old where possible and compare results.
  • Define in advance the measures and thresholds for moving to the next stage.
  • Monitor more closely than in steady state, including manual review of samples.
  • Keep the ability to return to the previous version at once.
  • Record the decision to expand, with the evidence.

Evidence it operates

Design: a rollout plan with stages, measures and exit criteria. Operation: records of each stage with the measures observed; a decision record for each expansion; an instance in which a rollout was paused or reversed.

Where it fits

Operates at deployment and for a defined period after. It supports model not fit for its intended purpose and inadequate pre-deployment testing by finding what earlier testing missed, and depends on drift and performance monitoring.

Limits

The pilot group may not represent the full population, so rare problems and problems for particular groups may not appear. People in the pilot are exposed to an unproven system and need the same protections as later users. A rollout that expands on a calendar and not on evidence is a staged launch in name only.

Risks this mitigates

Supporting mappings

Evaluation contamination and overstated performance Medium
Real-use results expose overstated benchmarks. Test data overlaps with training data, or benchmarks do not reflect real use, so reported performance is better than the system will deliver.
Inability to stop or roll back AI High
Limits exposure so a rollback affects fewer people. A misbehaving system cannot be disabled, reverted to a known good version, or have its actions reversed quickly enough to limit harm.
Inadequate pre-deployment testing High
Limited release finds what testing missed. A system goes live without testing proportionate to its risk, including functional, safety, security and user testing in realistic conditions.
Model not fit for its intended purpose High
Limits exposure while fitness is confirmed in use. A model is deployed without evidence that it performs well enough for the specific task, population and conditions in which it is used.

Framework and clause references

FrameworkClauseTitle
ISO/IEC 42001:2023Annex A.6AI system life cycle Deployment within the lifecycle.
NIST AI Risk Management Framework (AI RMF 1.0)MANAGE 2Strategies to maximise benefit and minimise harm are planned Planned strategies to limit harm.

Related terms

How to cite

Axiom Verity (2026). Staged rollout. Reference Library, C-045. https://axiom-verity.com/controls/staged-rollout. Reviewed 2026-11-10.