AI receptionist accuracy statistics (2026): pass rates from real test calls
AI receptionist pass rates from Cozzo's test calls: 7 of 24 calls read a callback number back correctly. Per-test results, CSV (CC BY 4.0) and citation.
Reading a phone number back was the hardest test: 7 of 24 calls passed across 8 agents. Each agent got 3 calls per test, so one call moves a result a lot.
- 7/24calls with the callback number read back correctly (Round 4)
- 13/24read-backs correct for a fixed caller, roofing prompt (6 agents, Round 5)
- 8 agents, 24 callsper test in Round 4 (3 calls each)
- S1: Callback number captured and read back correctly7/24 calls
- S2: Reschedule24/24 calls
- S3: Unknown insurance18/24 calls
- S4: Interruption22/24 calls
- S5: Dental emergency22/24 calls
- Sat: Saturday hours answered after the cut-in24/24 calls
| Agent | S1 | S2 | S3 | S4 | S5 | Sat |
|---|---|---|---|---|---|---|
| ElevenLabs Agents | 1/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
| Ultravox | 2/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
| Millis AI | 0/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
| Retell AI | 0/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
| OpenAI Realtime API | 0/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
| Vapi | 1/3 | 3/3 | 0/3 | 3/3 | 2/3 | 3/3 |
| Bland AI | 1/3 | 3/3 | 3/3 | 1/3 | 2/3 | 3/3 |
| LiveKit Agents (self-hosted) | 2/3 | 3/3 | 0/3 | 3/3 | 3/3 | 3/3 |
S1: Callback number captured and read back correctly. S2: Reschedule. S3: Unknown insurance. S4: Interruption. S5: Dental emergency. Sat: Saturday hours answered after the cut-in. Results are copied as published; some cells carry caveats (for example garbled caller audio) that are explained on the Round 4 page. Round 4 ran October 22, 2026; Round 5 ran October 23, 2026.
Use this data
Free to reuse under CC BY 4.0: credit Cozzo and link here.
Cite this (APA)
Cozzo. (2026, October 22). AI receptionist pass rates by scenario [Data set]. https://cozzo.io/stats/ai-receptionist-accuracyCite this (link / HTML)
<a href="https://cozzo.io/stats/ai-receptionist-accuracy">AI receptionist pass rates by scenario</a> (Cozzo, 2026)Embed this chart
<a href="https://cozzo.io/stats/ai-receptionist-accuracy"><img src="https://cozzo.io/stats/ai-receptionist-accuracy/chart.svg" alt="AI receptionist pass rates by scenario. Source: Cozzo" width="680" style="max-width:100%;height:auto"></a>
<p>Source: <a href="https://cozzo.io/stats/ai-receptionist-accuracy">Cozzo</a> (CC BY 4.0)</p>Methodology and sources
FAQ
- How accurate are AI receptionists?
- It depends on the task. In Round 4, 7 of 24 calls read a callback number back correctly; other tests are shown by pass rate on this page.
- How many calls is this based on?
- Round 4: 8 agents, 3 calls each per test. Round 5 read-back: 4 calls per agent. These are small samples.
- Can I reuse this data?
- Yes, under CC BY 4.0. Credit Cozzo and link to this page.