For Heads-of · Practitioner
Untested AI failure scenarios
No scenario testing exists for AI-specific disruption modes against the organisation's impact tolerances.
- medium
- operational-resilience
- scenario-testing
How it happens
Scenario testing covers conventional disruptions, data centre loss, cyberattack, staff unavailability, but no scenario specifically tests a model provider outage, a silent accuracy degradation, or a poisoned model update.
Why it matters
A resilience framework is only as good as the scenarios it tests; skipping AI-specific scenarios means the organisation's confidence in its resilience hasn't actually been tested against its most novel dependency.
Mitigating controls
The controls that address this risk, ranked by effectiveness.
AI incident response and rollback
Defined containment, remediation, and rollback procedure for a detected AI system failure or harmful output.
Important business service impact-tolerance mapping
A maintained map of where AI systems sit within important business services, with an AI-specific impact tolerance defined for each.
Framework and clause references
| Framework | Clause | Title |
|---|---|---|
| SS1/21: Operational Resilience | Scenario testing | Scenario testing |
Related resources
The external sources behind this risk, from the Resources library.