Customer Service Automation Metrics That Matter
Automation is only worth it if customers get faster, better answers. These metrics show whether your AI and messaging setup is helping customers or just deflecting them.
In ShortTrack speed (first reply time), outcome (resolution rate), automation (containment and handover), satisfaction (CSAT) and cost per resolved conversation. Watch them together — high containment with falling CSAT is a warning sign.
The Core Metrics
| Metric | What it measures | Watch for |
|---|---|---|
| First reply time | Time from customer message to first answer | Spikes outside business hours |
| Resolution rate | Share of conversations solved | Conversations closed without an answer |
| Containment rate | Share solved by AI without a person | Rising containment with falling CSAT |
| Handover rate | Share passed from AI to a person | Topics that always hand over — add knowledge |
| CSAT | Customer rating after the conversation | Low scores on specific intents |
| Cost per resolution | Messaging, AI and team cost per solved conversation | Channel and provider differences |
How to Use Them
- Measure for two weeks before changing anything.
- Review the top ten handover reasons each month and fill the gaps.
- Read a sample of AI conversations every week.
- Compare by channel — WhatsApp, web chat and calls behave differently.
FAQ
What is a good chatbot containment rate?
It depends on your questions. Track it alongside CSAT — a high rate only counts if customers are satisfied.
How do I measure CSAT in WhatsApp?
Send a short rating question with reply buttons after the conversation closes.
Should handovers be counted as failures?
No. Handing complex or sensitive conversations to a person is correct. Only repeated handovers for simple questions point to gaps.
Which metric matters most?
Resolution rate with CSAT. Fast replies don't help if the problem isn't solved.
Not Sure Which Fits?
Find the right setup for your team, or start your own Arino One Studio.
Start with the free Remix or a managed plan from $99/month. Providers bill you directly. Compare Plans