Risk · R-056 · Agentic & Autonomous Systems
Cascading failures in agent workflows
An error or compromise in one agent or step propagates through chained agents and automated workflows faster than people can notice or intervene.
- Severity
- High
- Audience
- Heads-of · Practitioner
- Frameworks
- MANAGE 4 · ASI08 · Scenario testing
- Responsible AI domain
- Lifecycle stage
- Reviewed
- 2026-11-10
What it is
This entry is about propagation, whatever the origin. A hallucinated value, a poisoned memory or a faulty tool starts as one fault. Because agents act on each other's output, store it and delegate from it, the fault is copied, amplified and made persistent. The root causes have their own entries; the cascade is a distinct risk because it calls for containment.
How it happens
- One agent's wrong output becomes another's trusted input.
- Agents retry and escalate automatically, multiplying the action.
- A faulty result is saved and reused in later runs.
- Several workflows share an agent, a tool or a memory, giving the fault a path between them.
Why it matters
Step-by-step human checks are what usually stop an error spreading, and autonomous chains remove them. The time from first fault to widespread harm can be seconds, and the saved state means the harm resumes after a restart.
Warning signs
- No workflow has a defined point at which it halts for a person.
- Volumes of an action rise sharply without a matching business cause.
- The same error appears in several agents' output within minutes.
- No one can say which workflows share which components.
Who owns it
The owner of the business process is accountable for its resilience. Engineering owns checkpoints and limits. The operational resilience function includes agent cascades in scenario testing.
In practice
A pricing agent misreads a data feed and lowers one product's rate. A second agent, which keeps offers in line with published rates, updates live quotations. A third sends the new quotation to customers who had asked to be alerted. The error reaches customers before the first agent's output has been looked at. The same pattern generalises to any chain where agents consume each other's output without a checkpoint.
Mitigating controls
Primary controls
- Approval gates for high-impact agent actions Preventive
- Places checkpoints that stop propagation before high-impact steps. Before an agent takes an action above a defined impact threshold, or one that cannot be reversed, a designated person reviews the exact action and approves or rejects it.
- Human override and stop mechanism Corrective
- Lets a person halt the whole workflow. A designated person can pause, override or shut down an AI system at any time through a tested mechanism, with the authority to do so settled in advance.
Supporting controls
- AI failure scenario testing Detective
- Exercises cascade scenarios. Severe but plausible AI failure scenarios are exercised against impact tolerances on a set cycle, and the lessons are acted on.
- AI system monitoring and logging Detective
- Detects abnormal activity across the chain. Every production AI system is instrumented to record its inputs, outputs, errors and usage, with thresholds that raise alerts to a named owner who must act.
- Inference usage quotas and rate limiting Preventive
- Rate limits slow a runaway chain. Limits on request rate, input size, output size and spend are enforced for each user, tenant and system, with alerts as limits are approached.
Framework and clause references
| Framework | Clause | Title |
|---|---|---|
| NIST AI Risk Management Framework (AI RMF 1.0) | MANAGE 4 | Risk response, recovery and communication plans are documented and monitored Response and recovery. |
| OWASP Top 10 for Agentic Applications | ASI08 | Cascading Failures The entry this risk is named for. |
| SS1/21: Operational Resilience | Scenario testing | Scenario testing Cascades belong in scenario testing. |
Sources
- SS1/21: Operational Resilience Bank of England PRA · official text
- NIST AI Risk Management Framework (AI RMF 1.0) NIST · framework
Related terms
How to cite
Axiom Verity (2026). Cascading failures in agent workflows. Reference Library, R-056. https://axiom-verity.com/risks/cascading-failures-in-agent-workflows. Reviewed 2026-11-10.
Found an error or a better source? Report a correction.