AI Agent Failure Modes: Six Ways Agents Break and How to Prevent Them
Agent failures are not random. They follow predictable patterns that experienced practitioners have learned to recognize and design against. Here are six failure modes that appear repeatedly in real-world agent deployments, with specific countermeasures that work against each one, and the design principles that address the most failure modes simultaneously.
Why Agent Failures Are Harder Than Chatbot Failures
When a chatbot gives a wrong answer, a person reads it and can choose not to act on it. The human is in the loop between the chatbot's output and any real-world consequence. When an agent makes a wrong decision, it acts immediately. There is no human review between the decision and its execution. The agent has already sent the email, modified the record, or triggered the downstream process.
This does not mean agents are too risky to use. It means their failure modes must be understood before deployment, not diagnosed after an incident. The six modes below account for the large majority of real-world agent problems. None of them are obscure edge cases. They are predictable consequences of agentic architecture that can be designed against if you know to look for them.
The Six Failure Modes
The Minimal Footprint Principle
The single design principle that addresses the most failure modes simultaneously is minimal footprint: an agent should acquire only the resources, permissions, and capabilities it needs for the current task, should prefer reversible actions over irreversible ones when both options are available, and should release permissions when they are no longer needed.
An agent that can do less cannot fail catastrophically. Narrow the blast radius before the blast happens.
This principle conflicts directly with the instinct to give agents powerful, broad access so they can handle more situations without needing to request additional permissions. That breadth comes at the cost of consequences when something goes wrong. A customer service agent that only has read access to order records cannot accidentally modify them. An agent that can only send emails to existing customers in the system cannot accidentally contact someone it should not. A financial agent that can only read transaction records cannot accidentally process a payment.
Implementing minimal footprint requires thinking carefully about the permission model before deployment, not after. What is the minimum set of permissions this agent needs to complete this specific task? What actions are irreversible and therefore require stronger preconditions? What permissions should be time-limited rather than persistent? These are architecture questions, not implementation details.
Human-in-the-Loop Checkpoints
Not every decision should go to a human for review: that would defeat the purpose of an agent. But certain categories of action warrant a pause and a human confirmation before proceeding. The challenge is designing checkpoints that catch the failures that matter without creating so much friction that the agent stops being useful.
Actions that consistently warrant a checkpoint: sending communications to external parties, modifying records that cannot be easily restored, spending money above a defined threshold, accessing data outside the original scope of the task, and taking any action that the agent itself flags as uncertain or unusual in its reasoning step. That last category is underused: agents often signal their own uncertainty in the Thought step, and systems that detect and act on those signals catch many errors before they become actions.
Each human checkpoint is also a data collection point. Every time a human overrides an agent decision or requests a revision, that interaction is information about where the agent's judgment diverges from the organization's actual preferences. That information, collected systematically over time, improves the system prompt, the tool descriptions, and eventually the fine-tuning data for future agent versions.
Dry Runs Before Real Actions
For any agent that takes irreversible real-world actions, a dry-run mode is a valuable design pattern. In dry-run mode, the agent goes through its full reasoning and planning cycle and generates a complete list of actions it would take, without actually taking them. A human reviews the plan, approves or modifies it, and then the agent executes.
This does not work for all use cases, particularly time-sensitive ones. But for agents running scheduled tasks, batch processes, or any workflow where latency is not critical, the dry-run review step catches a large fraction of errors before they become incidents. An agent that sends a weekly summary email to a thousand customers can run the planning phase on Monday, get human review on Tuesday, and execute on Wednesday, with the review adding minimal friction to a task that runs infrequently.
The dry-run pattern also serves as documentation. The list of planned actions is a record of what the agent intended to do, which is useful both for pre-execution review and for post-execution audit. If something goes wrong despite approval, the plan provides a starting point for understanding what the agent was trying to accomplish and where the decision to approve went wrong.
Building a Culture of Agent Safety
Technical safeguards address the mechanics of agent failures, but the organizational context in which agents are deployed matters just as much. Teams that move too quickly from prototype to broad deployment, that do not invest in logging and observability, or that do not have clear escalation paths for agent incidents will encounter failures that their technical safeguards cannot catch.
A healthy agent deployment culture has several characteristics. Incidents are documented: when an agent fails, the team records what happened, what the root cause was, and what change prevents the same failure in the future. Permissions are reviewed periodically: access that was granted for a specific task and not revoked accumulates over time and creates unnecessary risk. New agents are introduced incrementally: a new agent is piloted with a small subset of tasks and reviewed carefully before expanding to full load.
The six failure modes in this article are not the complete list of ways agents can fail. They are the most common ones observed across a range of real deployments. As agents become more capable and are given broader scope, new failure modes will emerge. The organizations best positioned to handle them are those that have already built the habit of designing for failure before it happens, rather than discovering the failure modes one incident at a time.
The next article in this series covers the six-step build process that incorporates failure mode prevention from the start, rather than as an afterthought once the agent is already deployed.
Measuring Failure Rate as a Deployment Metric
One of the most useful shifts a team can make is treating agent failure rate as a first-class deployment metric, tracked with the same rigor as uptime or latency. Without explicit measurement, failure rate is invisible until a user reports a problem, and user reports are a lagging indicator that captures only a fraction of actual failures. By the time a pattern shows up in support tickets, the agent may have made hundreds of incorrect decisions that no one noticed.
Defining what counts as a failure is the first step, and it is not as obvious as it sounds. A timeout is clearly a failure. But what about an agent that completes the task correctly according to its instructions but takes an action the user did not intend because the instructions were ambiguous? What about an agent that returns a plausible-sounding answer that is factually wrong? Different teams will draw the line differently based on their specific use case, but drawing a line explicitly and logging against it is what matters.
Three metrics together give a reasonable picture of agent reliability: task completion rate (the fraction of tasks that produce an output without a hard error or timeout), outcome accuracy (the fraction of completed tasks where the output is correct, measured against a human-labeled sample), and escalation rate (the fraction of tasks the agent routes to a human reviewer). Rising escalation rate is an early warning sign that the agent is encountering inputs outside its reliable capability. Falling completion rate suggests a tool or infrastructure problem. Falling accuracy with stable completion rate suggests a model or prompt problem.
Sharing these metrics with the broader team, not just the engineering team, creates accountability and encourages the organizational habits described above. When a product manager can see that the agent's accuracy on a particular task type dropped noticeably over the past two weeks, the conversation about what changed and how to fix it happens faster than if the data lives only in a private dashboard that no one outside engineering looks at regularly.
Take the free course
Six modules covering agents, tools, memory, multi-agent systems, failure modes, and building your first agent. No signup required.
Start the AI Agents Course →References
- Perez, F. and Ribeiro, I. (2022). Ignore Previous Prompt: Attack Techniques For Language Models. arXiv:2211.09527. https://arxiv.org/abs/2211.09527
- Greshake, K. et al. (2023). Not What You've Signed Up For: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection. arXiv:2302.12173. https://arxiv.org/abs/2302.12173
- Yao, S. et al. (2022). ReAct: Synergizing Reasoning and Acting in Language Models. arXiv:2210.03629. https://arxiv.org/abs/2210.03629
- Mialon, G. et al. (2023). Augmented Language Models: A Survey. arXiv:2302.07842. https://arxiv.org/abs/2302.07842
- Karpas, E. et al. (2022). MRKL Systems: A Modular, Neuro-Symbolic Architecture That Combines Language Models, External Knowledge Sources and Discrete Reasoning. arXiv:2205.00445. https://arxiv.org/abs/2205.00445
- Schick, T. et al. (2023). Toolformer: Language Models Can Teach Themselves to Use Tools. arXiv:2302.04761. https://arxiv.org/abs/2302.04761