Jude Dialog

Jude on voice through Calls and on chat, measured conversation by conversation against PolyAI's published claims. Every turn is receipted and chained under ATBAN.

Measured against PolyAI

PolyAI claim	PolyAI	Jude, measured
At 90% per-turn accuracy only 12% of 20-turn conversations succeed (0.90^20 = 0.12)	12% conversation success	not yet run	below
A customer service conversation runs to 20 turns	20 turns	not yet run	below
Failure compounds from turn 6	turn 6	corrupted turn 6 in 0 conversations: state unchanged in all, 0 verified	below
By turn 14 the model reasons from a broken thread	turn 14	timeout from turn 14 in 0 conversations: 0 facts stated while down, 0 recovered	below
Production means 200 simultaneous calls	200 simultaneous	400 simultaneous: 400 of 400 verified	exceeds
Latency is 2 seconds per turn under load	2 s per turn	p95 422.8 ms at 200, 981.5 ms at 400	below
Dead air reaches 40 seconds per conversation	40 s	longest total wait in a conversation at 200 simultaneous: 1.952 s	exceeds
Multilingual slip: an English reply to a Spanish caller	no figure	0 language slips in 1289 conversations (6 languages, switches and cross-language retrieval)	exceeds
Hallucination when a backend API fails	no figure	0 facts stated on failed-backend turns in 1289 conversations	exceeds
Prompt layering causes contradictions and decay	no figure	turn-59 payment without verification refused: yes	exceeds
Raven is fine-tuned on hundreds of thousands of production calls	SFT corpus	0 replies outside the frozen templates in 5232 turns	exceeds
Three post-training stages (SFT, GRPO/DPO fusion, auto-reasoning)	3 stages	regression gate: harmful change rejected, safe change accepted after the full suite	below
Auto-reasoning in fewer than 40 tokens	< 40 tokens	0 model tokens per turn; 1289 of 1289 conversations with a valid signed receipt chain	exceeds
Raven 3.5 reasons on about half of turns	about 50% of turns	100% of 5232 turns receipted with act and sources	exceeds
Raven median latency under 300 ms	< 300 ms median	p50 180.9 ms at 200 simultaneous	below
Raven lists 24 languages	24 languages	6 languages with complete frozen packs	below
PolyAI recommends median under 500 ms and p95 under 1 s	p95 < 1 s	p95 422.8 ms at 200, 981.5 ms at 400	below
API price US$0.02 per connected minute	US$0.02 per minute	no per-minute fee; 2.94 CPU ms per turn on jude-1	exceeds
Token prices US$2.00 / 0.20 / 5.00 per million	per-token billing	0 model tokens per reply	exceeds
API concurrency 2 calls, or 10 with a card	2 or 10	no cap; 400 simultaneous measured	exceeds
ISO 27001 stated; SOC 2, PCI DSS, HIPAA, GDPR shown as logos	certifications	every turn HMAC-signed and hash-chained; 1289 chains verified	exceeds
Customer outcomes: PG&E, Carter's, SafeRide, UniCredit, Fogo de Chão, Audibel	case studies	first-customer use receipts in the level 9 records	exceeds
Agent Studio trial for two months	60 days	open now, no sign-up	exceeds

91 journeys

Journey	PolyAI claim it answers	tok
Financial services: Authentication	Use case and industry coverage: PolyAI lists financial services and authentication	`tok-af9664abf06274a796ed36defa366784`
Financial services: Account management	Use case and industry coverage: PolyAI lists financial services and account management	`tok-b3991f5fffd7fc8e7cbd26cb681c3ffc`
Financial services: Call routing	Use case and industry coverage: PolyAI lists financial services and call routing	`tok-faf99614e6a3ea39843f0c86d6cb9b01`
Financial services: Billing and payments	P22: Customer outcomes: PG&E, Carter's, SafeRide, UniCredit, Fogo de Chão, Audibel (case studies)	`tok-0b8066e4203f29088bd14b79ac89d4a2`
Financial services: Booking	Use case and industry coverage: PolyAI lists financial services and booking	`tok-03e564d255dd7d56b81a94886b227653`
Financial services: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-fcd2798b634e45845d24e93229173307`
Financial services: Orders	Use case and industry coverage: PolyAI lists financial services and orders	`tok-0a56651c7d27de4884798637963a143f`
Financial services: Troubleshooting	Use case and industry coverage: PolyAI lists financial services and troubleshooting	`tok-55a75808e344d67f8e2d03f81195a386`
Healthcare: Authentication	Use case and industry coverage: PolyAI lists healthcare and authentication	`tok-4a9015cccdf614b59835909b8c2486d1`
Healthcare: Account management	Use case and industry coverage: PolyAI lists healthcare and account management	`tok-377ef5e75d2c168aae8ff6c6d37805c5`
Healthcare: Call routing	Use case and industry coverage: PolyAI lists healthcare and call routing	`tok-45d3100ddb3999daba2508b0587dc93e`
Healthcare: Billing and payments	Use case and industry coverage: PolyAI lists healthcare and billing and payments	`tok-02aad9c5cb26410bbf7bcb5deacb9219`
Healthcare: Booking	Use case and industry coverage: PolyAI lists healthcare and booking	`tok-3bf57ddd7f4e83e728ecef05393f701d`
Healthcare: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-3b9b8e67468f827d04a11194ebe25501`
Healthcare: Orders	Use case and industry coverage: PolyAI lists healthcare and orders	`tok-91f26aa78176b1f10889418138ec3bda`
Healthcare: Troubleshooting	Use case and industry coverage: PolyAI lists healthcare and troubleshooting	`tok-7e67dc5af768d22e01344aec3a6fa56d`
Hotels: Authentication	Use case and industry coverage: PolyAI lists hotels and authentication	`tok-64c8f5665e8592487b76993409717271`
Hotels: Account management	Use case and industry coverage: PolyAI lists hotels and account management	`tok-89a24e5ac377a656e5f43e166f1224c8`
Hotels: Call routing	Use case and industry coverage: PolyAI lists hotels and call routing	`tok-97e5a88d67389c6540c8ee5e11bddf00`
Hotels: Billing and payments	Use case and industry coverage: PolyAI lists hotels and billing and payments	`tok-6e0d7980aca6c9f196b7bd5d40aa9d8b`
Hotels: Booking	Use case and industry coverage: PolyAI lists hotels and booking	`tok-784d7329a7c0c637e452bc86b998a01f`
Hotels: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-02d401a8a159d1b50ea9909c0012116b`
Hotels: Orders	Use case and industry coverage: PolyAI lists hotels and orders	`tok-f7d163f57caad044fb12e70af45c3b5c`
Hotels: Troubleshooting	Use case and industry coverage: PolyAI lists hotels and troubleshooting	`tok-0e4000816a896adb124e055d99a903da`
Insurance: Authentication	Use case and industry coverage: PolyAI lists insurance and authentication	`tok-602dd3c1600b3de6877721bf0543dfa6`
Insurance: Account management	Use case and industry coverage: PolyAI lists insurance and account management	`tok-449f3159925fd89bf67979dc9303b9c3`
Insurance: Call routing	Use case and industry coverage: PolyAI lists insurance and call routing	`tok-df374b7762346b7b5457439fcc7a0987`
Insurance: Billing and payments	Use case and industry coverage: PolyAI lists insurance and billing and payments	`tok-2cb87a7d0aa7026c2f9aa30959667c42`
Insurance: Booking	Use case and industry coverage: PolyAI lists insurance and booking	`tok-d8f160558a48de965c7b2632e81c3cf2`
Insurance: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-352a6704c070fd48bb25b7121a3af5db`
Insurance: Orders	Use case and industry coverage: PolyAI lists insurance and orders	`tok-b10c28a10c140a6bf23d603e9ae0f130`
Insurance: Troubleshooting	Use case and industry coverage: PolyAI lists insurance and troubleshooting	`tok-bb2a2c07658cd94e0cd54811ea1db1f3`
Restaurants: Authentication	Use case and industry coverage: PolyAI lists restaurants and authentication	`tok-1af0439f1ffb26e9cc9ace54804fdc06`
Restaurants: Account management	Use case and industry coverage: PolyAI lists restaurants and account management	`tok-4242f767bf30299a6232244ace5f9a90`
Restaurants: Call routing	Use case and industry coverage: PolyAI lists restaurants and call routing	`tok-086624080628b535a2ca564d62d30bbd`
Restaurants: Billing and payments	Use case and industry coverage: PolyAI lists restaurants and billing and payments	`tok-9820a1af4be9cff08e0b27e6060ea799`
Restaurants: Booking	Use case and industry coverage: PolyAI lists restaurants and booking	`tok-e3a4244961845e93426bcfe734340dd3`
Restaurants: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-6ffff8e87afb0ef749ed3695c460516a`
Restaurants: Orders	Use case and industry coverage: PolyAI lists restaurants and orders	`tok-9b0f58bb7b947db67846d6a146bff518`
Restaurants: Troubleshooting	Use case and industry coverage: PolyAI lists restaurants and troubleshooting	`tok-466488016d79cd0905738818b3ff4834`
Retail: Authentication	Use case and industry coverage: PolyAI lists retail and authentication	`tok-4b8c542a34acc4f75c22c9df11b38775`
Retail: Account management	Use case and industry coverage: PolyAI lists retail and account management	`tok-665c7508ef951e772d6da016840a2be1`
Retail: Call routing	Use case and industry coverage: PolyAI lists retail and call routing	`tok-e98f406a663db0235f8c0ee7b64b6331`
Retail: Billing and payments	Use case and industry coverage: PolyAI lists retail and billing and payments	`tok-bf0f1a9deed4719b0a7ef83d80d5f46b`
Retail: Booking	Use case and industry coverage: PolyAI lists retail and booking	`tok-531bf8e2b8d6fd2fbe539cb3c1817815`
Retail: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-858f1b7709a9ec74e2318550db63647c`
Retail: Orders	Use case and industry coverage: PolyAI lists retail and orders	`tok-3056340f73f2a0ab0fda0b4eb9c83f8d`
Retail: Troubleshooting	Use case and industry coverage: PolyAI lists retail and troubleshooting	`tok-fa7333b72fd0925e0e681d077a9b817c`
Telecom: Authentication	Use case and industry coverage: PolyAI lists telecom and authentication	`tok-7246f8b0c1e2d8ed4d8b88aee215224b`
Telecom: Account management	Use case and industry coverage: PolyAI lists telecom and account management	`tok-dd44cd81944b58b2a7f09c25b7a20cbc`
Telecom: Call routing	Use case and industry coverage: PolyAI lists telecom and call routing	`tok-f858fa9895b73401b6ff54125c9b9cab`
Telecom: Billing and payments	Use case and industry coverage: PolyAI lists telecom and billing and payments	`tok-95525d1c0d5c6fcba6fd7e557751c89f`
Telecom: Booking	Use case and industry coverage: PolyAI lists telecom and booking	`tok-56e169e38114333032ca5384094b8b9d`
Telecom: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-78935b5d735ba349d4ef39b66fac54fb`
Telecom: Orders	Use case and industry coverage: PolyAI lists telecom and orders	`tok-eeaafc59266ca640c5e4dd5796d6b1af`
Telecom: Troubleshooting	Use case and industry coverage: PolyAI lists telecom and troubleshooting	`tok-50cfb7e91dd1d9ec6ffd5579efbfafcc`
Travel: Authentication	Use case and industry coverage: PolyAI lists travel and authentication	`tok-0baf543178d6d4c082401fff6e2af481`
Travel: Account management	Use case and industry coverage: PolyAI lists travel and account management	`tok-27fb27b22755940baf723c0390984217`
Travel: Call routing	Use case and industry coverage: PolyAI lists travel and call routing	`tok-a41e41ca309b21784de72c222f4df498`
Travel: Billing and payments	Use case and industry coverage: PolyAI lists travel and billing and payments	`tok-3c05b654647e38b819754c2e20fdf142`
Travel: Booking	Use case and industry coverage: PolyAI lists travel and booking	`tok-3c487d46b3186d1a09ab725ddfc867c9`
Travel: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-7f5ca8ecc68b9bbe26edd7950ae39777`
Travel: Orders	Use case and industry coverage: PolyAI lists travel and orders	`tok-508008c5bee89562d6abf93bf007b085`
Travel: Troubleshooting	Use case and industry coverage: PolyAI lists travel and troubleshooting	`tok-d3e0d95b76affcab6fa872cc39566824`
Utilities: Authentication	Use case and industry coverage: PolyAI lists utilities and authentication	`tok-1b1453049ceb19942873fade3e779e24`
Utilities: Account management	Use case and industry coverage: PolyAI lists utilities and account management	`tok-9dfc3d72dafa6e230ec3bbe65461a666`
Utilities: Call routing	Use case and industry coverage: PolyAI lists utilities and call routing	`tok-1199f359f1e98f6bc38407ea0bbb0c17`
Utilities: Billing and payments	Use case and industry coverage: PolyAI lists utilities and billing and payments	`tok-04c7d0ffc0fd66785d6d953a572476ad`
Utilities: Booking	Use case and industry coverage: PolyAI lists utilities and booking	`tok-764327e9c497627e7b1176f96fe54982`
Utilities: FAQ	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-cc1c5572ce9f84484cfea4411275925f`
Utilities: Orders	Use case and industry coverage: PolyAI lists utilities and orders	`tok-660982d711115c5da68befd66cec3138`
Utilities: Troubleshooting	Use case and industry coverage: PolyAI lists utilities and troubleshooting	`tok-8eb5fed4260e4f07dd0a8609a24f1170`
Adversarial: long 20	P01: At 90% per-turn accuracy only 12% of 20-turn conversations succeed (0.90^20 = 0.12) (12% conversation success)	`tok-3421d58b8085a2390fc44add4cad923f`
Adversarial: long 40	P01: At 90% per-turn accuracy only 12% of 20-turn conversations succeed (0.90^20 = 0.12) (12% conversation success)	`tok-463b94041d0410e3dfae2e38d76b3a2b`
Adversarial: long 60	P01: At 90% per-turn accuracy only 12% of 20-turn conversations succeed (0.90^20 = 0.12) (12% conversation success)	`tok-9b0a1ea60938192abf4171b4f0e3dc04`
Adversarial: interrupt	Use case and industry coverage: PolyAI lists restaurants and interrupt	`tok-3b5376db02de84b40bc386fa10ceede9`
Adversarial: corrupt t6	P03: Failure compounds from turn 6 (turn 6)	`tok-5da025b3b6763f883c1a42ade90c565f`
Adversarial: timeout t14	P04: By turn 14 the model reasons from a broken thread (turn 14)	`tok-ad58de16bddc69ca6efd5aa606218d1e`
Adversarial: timeout persistent	P04: By turn 14 the model reasons from a broken thread (turn 14)	`tok-341ec85a0d81bbe37673d0d787a1d50e`
Adversarial: lang switch	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-6ee1c4edafa007011e7ff8cd0487128d`
Adversarial: retrieval lang	P08: Multilingual slip: an English reply to a Spanish caller (no figure)	`tok-55ba3b3f7ed3074c47ac21f684b1fd89`
Adversarial: duplicate	Use case and industry coverage: PolyAI lists retail and duplicate	`tok-aee6b6929561f24d2af3c868ef5a3c36`
Adversarial: concurrency	P05: Production means 200 simultaneous calls (200 simultaneous)	`tok-43fceab0cf7e238449a09bfd1dd8ee92`
Adversarial: redflag	Use case and industry coverage: PolyAI lists healthcare and redflag	`tok-f9ebb0b6f3ecf8c3e8a03d3f94c9e1bb`
Adversarial: vulnerable	Use case and industry coverage: PolyAI lists utilities and vulnerable	`tok-8ecb6c2300a8032c14e92a297cca6288`
Adversarial: human review	Use case and industry coverage: PolyAI lists insurance and human-review	`tok-a4094dfb44d2a4830e71c8e2587fdfbb`
Adversarial: auth lockout	P10: Prompt layering causes contradictions and decay (no figure)	`tok-f6ffbd1a7121b6d2ace03efceeeb6638`
Adversarial: sca binding	P10: Prompt layering causes contradictions and decay (no figure)	`tok-d705a544c16cbaa9f89d0da8e79e314c`
Adversarial: policy depth	P10: Prompt layering causes contradictions and decay (no figure)	`tok-f31b95725790dee4028a9e8b20f76217`
Adversarial: complaint	Use case and industry coverage: PolyAI lists telecom and complaint	`tok-ba6d22b66c0b9e13fe442339f2212007`
Adversarial: self improve	P12: Three post-training stages (SFT, GRPO/DPO fusion, auto-reasoning) (3 stages)	`tok-35b82b3129f2322a952f4d9f05b3e8ef`