Compounding Error
The multiplicative decay of an AI agent's reliability across the many steps of a task: if each step succeeds independently with probability *p*, an *n*-step task succeeds with probability *pⁿ*. This is the mathematical reason agents that demo brilliantly disappoint in production — demos are short, real tasks are long. The numbers are unforgiving: a 95%-per-step agent (nineteen of twenty tool calls perfect) is only ~60% reliable across ten steps and ~36% across twenty; a 90% agent is a coin flip by seven steps. Worse than the arithmetic, errors *cascade*: a wrong step feeds a wrong observation into the next decision, so the agent reasons confidently from a false premise — coherent failure, which humans are slow to catch. Three design consequences follow: shorter tasks beat smarter models (cutting steps beats a marginal accuracy gain), a single weak step sets the whole chain's reliability (reliability tracks your *weakest* step, not your average), and the escape is verification *between* steps plus keeping *n* small. See Agent Reliability and Non-Determinism.
Written by Max Zeshut
Founder at Agentmelt · Last updated Sep 9, 2026
Example
A research agent runs 20 tool calls at 95% each. It feels reliable — until you compute 0.95²⁰ ≈ 0.36: nearly two-thirds of full runs contain at least one error, and because errors cascade, one bad retrieval early makes every later step reason from a false fact. Splitting the task into two 10-step agents with a verification checkpoint between them, each catching errors before they propagate, roughly doubles end-to-end success.
Frequently asked questions
- How do I fight compounding error?
- Two levers, both structural. First, reduce *n*: decompose long tasks into short, verifiable sub-tasks so there's less to compound. Second, verify between steps: add checks (validation, an LLM judge, a human gate) that catch and correct an error before it feeds the next decision. Chasing a higher per-step *p* helps a little but never reaches 100% — you can't buy your way out of the exponent, you have to shrink it and check your work as you go.
- Why is compounding error worse than random failure?
- Because agent errors don't stay contained — they cascade. A wrong step produces a wrong observation, which the agent treats as ground truth for the next decision, so the whole remainder of the run is confidently, coherently wrong rather than obviously broken. Coherent wrong answers are the hardest kind for a human reviewer to spot, which is exactly why failing loudly and verifying between steps matter so much.