Containment rate is the share of conversations an AI agent or bot finishes without a human handoff. It counts conversations that never reached a person, so a customer who gave up counts the same as one whose problem was solved.
In short
- It measures deflection, not resolution.
- A high rate can hide a bad customer experience.
- Pair it with a check on how many contained conversations were resolved.
- Kaizo doesn’t sell AI agents, so it has no reason to flatter the number.
How containment rate is calculated
The formula is straightforward. Take the conversations that entered the automated channel over a period, count the ones that ended without being escalated to a human, and divide.
Containment rate = conversations resolved without human escalation / total conversations handled by the automation.
So if 1,000 conversations reach an AI agent in a week and 650 of them never touch a human, containment is 65%. The appeal is obvious: it maps almost directly onto cost, because a contained conversation carries no agent handling time. That is also why it tends to become the number a bot deployment is judged on, and why it deserves more scrutiny than it usually gets.
Why the number can mislead
The weakness is in the word “resolved” in that formula, because most containment measurements do not actually check for resolution. They check for the absence of a human. Those are not the same thing, and the gap between them is where the metric goes wrong.
A conversation counts as contained if the customer got what they needed and left satisfied. It also counts as contained if the customer could not find an escalation path and gave up, if they abandoned the chat halfway through, if they got a wrong answer and did not realize it, or if the bot answered a question they were not asking and they closed the window. Every one of those is a failure, and every one of them improves the containment rate.
This creates a perverse incentive. The fastest way to raise containment is to make escalation harder, and a bot that hides the path to a human will post a better number than one that offers help the moment it is stuck. The metric rewards exactly the behavior that most damages the customer relationship.
Containment rate vs resolution rate
The distinction that fixes most of the problem is the one between containment and resolution.
| Containment rate | Resolution rate | |
|---|---|---|
| What it counts | Conversations that ended without a human | Conversations where the customer’s issue was actually solved |
| A customer who gives up | Counted as a success | Counted as a failure |
| What it is a proxy for | Cost avoided | Job done |
| How to measure it | Read the routing log | Read the conversation |
How to use containment rate honestly
The metric is not useless. It is a legitimate efficiency signal as long as it is never read alone. The honest way to use it is to pair it with a resolution check: of the conversations you contained, how many actually resolved the customer’s problem, and how many were abandonments or wrong answers wearing a containment badge.
Answering that means looking at what the AI agent said and whether it was correct, complete, and appropriate, which is a quality-assurance question, not an analytics one. It is the same discipline you would apply to a human agent, applied to a bot: read the interaction, score it against a rubric, and trace the score back to the evidence. Our guide to measuring containment rate without fooling yourself walks through how to do that, and how to QA AI agents and chatbots covers the scoring method underneath it.
One structural note. A platform that sells its own AI agents has a reason to prefer the flattering version of this number, because containment is how those agents are sold. Kaizo does not sell AI agents. It scores the conversations they produce, which means it can report true containment against abandonment with nothing to protect.
Frequently asked questions
What is a good containment rate?
There is no single benchmark worth quoting, because containment rate on its own does not tell you whether customers were helped. A high number produced by hiding the escalation path is worse than a lower number where every contained conversation was genuinely resolved. Judge containment against a resolution check rather than against an industry average.
What is the difference between containment rate and deflection rate?
They are often used interchangeably. Both describe conversations kept away from a human agent. Deflection sometimes refers specifically to steering a customer to self-service before a conversation starts, while containment usually refers to a conversation the automation handles to completion. Both share the same blind spot: neither, by default, checks whether the customer’s problem was solved.
Does a high containment rate mean the AI agent is working well?
Not by itself. Containment counts the absence of a human, not the presence of a resolution, so a customer who abandons the chat is counted as contained. To know whether the AI agent is working, pair containment with a resolution check that reads the actual conversations and scores whether each one solved the issue.
How do you measure whether a contained conversation was actually resolved?
By scoring the conversation itself, not the routing outcome. That means evaluating what the AI agent said against a rubric: was the answer correct, complete, and appropriate, and did the customer’s issue end resolved rather than abandoned. It is the same quality-assurance approach used on human agents, applied to automated conversations.
