Risk · R-056 · Agentic & Autonomous Systems

Cascading failures in agent workflows

An error or compromise in one agent or step propagates through chained agents and automated workflows faster than people can notice or intervene.

Severity
High
Audience
Heads-of · Practitioner
Frameworks
MANAGE 4 · ASI08 · Scenario testing
Reviewed
2026-11-10

What it is

This entry is about propagation, whatever the origin. A hallucinated value, a poisoned memory or a faulty tool starts as one fault. Because agents act on each other's output, store it and delegate from it, the fault is copied, amplified and made persistent. The root causes have their own entries; the cascade is a distinct risk because it calls for containment.

How it happens

  • One agent's wrong output becomes another's trusted input.
  • Agents retry and escalate automatically, multiplying the action.
  • A faulty result is saved and reused in later runs.
  • Several workflows share an agent, a tool or a memory, giving the fault a path between them.

Why it matters

Step-by-step human checks are what usually stop an error spreading, and autonomous chains remove them. The time from first fault to widespread harm can be seconds, and the saved state means the harm resumes after a restart.

Warning signs

  • No workflow has a defined point at which it halts for a person.
  • Volumes of an action rise sharply without a matching business cause.
  • The same error appears in several agents' output within minutes.
  • No one can say which workflows share which components.

Who owns it

The owner of the business process is accountable for its resilience. Engineering owns checkpoints and limits. The operational resilience function includes agent cascades in scenario testing.

In practice

A pricing agent misreads a data feed and lowers one product's rate. A second agent, which keeps offers in line with published rates, updates live quotations. A third sends the new quotation to customers who had asked to be alerted. The error reaches customers before the first agent's output has been looked at. The same pattern generalises to any chain where agents consume each other's output without a checkpoint.

Mitigating controls

Primary controls

Approval gates for high-impact agent actions Preventive
Places checkpoints that stop propagation before high-impact steps. Before an agent takes an action above a defined impact threshold, or one that cannot be reversed, a designated person reviews the exact action and approves or rejects it.
Human override and stop mechanism Corrective
Lets a person halt the whole workflow. A designated person can pause, override or shut down an AI system at any time through a tested mechanism, with the authority to do so settled in advance.

Supporting controls

AI failure scenario testing Detective
Exercises cascade scenarios. Severe but plausible AI failure scenarios are exercised against impact tolerances on a set cycle, and the lessons are acted on.
AI system monitoring and logging Detective
Detects abnormal activity across the chain. Every production AI system is instrumented to record its inputs, outputs, errors and usage, with thresholds that raise alerts to a named owner who must act.
Inference usage quotas and rate limiting Preventive
Rate limits slow a runaway chain. Limits on request rate, input size, output size and spend are enforced for each user, tenant and system, with alerts as limits are approached.

Framework and clause references

FrameworkClauseTitle
NIST AI Risk Management Framework (AI RMF 1.0)MANAGE 4Risk response, recovery and communication plans are documented and monitored Response and recovery.
OWASP Top 10 for Agentic ApplicationsASI08Cascading Failures The entry this risk is named for.
SS1/21: Operational ResilienceScenario testingScenario testing Cascades belong in scenario testing.

Sources

SS1/21: Operational Resilience Bank of England PRA · official text

Related terms

How to cite

Axiom Verity (2026). Cascading failures in agent workflows. Reference Library, R-056. https://axiom-verity.com/risks/cascading-failures-in-agent-workflows. Reviewed 2026-11-10.