{"type":"post","id":"using-a-smart-clip-router-to-benchmark-conversational-b36d84","slug":"using-a-smart-clip-router-to-benchmark-conversational-b36d84","title":"Using a Smart Clip Router to Benchmark Conversational Speech-To-Speech Agents Engineering LLM","description":"DoorDash describes OrderUp-Bench, a food-ordering benchmark that uses a smart router to let a simulated customer respond to voice agents with clips from real conversations.","retrieval_nugget":"DoorDash describes OrderUp-Bench, a food-ordering benchmark that uses a smart router to let a simulated customer respond to voice agents with clips from real conversations. Its comparison suggests that clean completion, recoverable mistakes, silent failures and interaction time tell different stories—so turn accuracy alone can mislead teams evaluating agents for real tasks.","published_at":"2026-11-14","updated_at":"2026-11-14","record_date":"2026-11-14","date_kind":"published_at","topics":["gemini"],"entities":["DoorDash","OrderUp-Bench","GPT Realtime 2","Gemini Flash Live 3.1","Grok Voice 1.0","Whisper","GPT-5.5"],"related_patterns":["ai-engineering-evaluations-are-splitting-into-task-specific"],"novelty_label":"new_fact","what_changed":"DoorDash introduces OrderUp-Bench for evaluating speech-to-speech food-ordering agents and reports differences in order accuracy, policy compliance, duration and silent failure across models.","prior_refs":["https://newruntime.com/posts/building-an-automated-improvement-harness-for-an-ai-74a2f3/"],"source_url":"https://careersatdoordash.com/blog/voice-agent-benchmark-smart-clip-router","source_urls":["https://careersatdoordash.com/blog/voice-agent-benchmark-smart-clip-router"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:using-a-smart-clip-router-to-benchmark-conversational-b36d84","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/using-a-smart-clip-router-to-benchmark-conversational-b36d84/","markdown":"https://newruntime.com/posts/using-a-smart-clip-router-to-benchmark-conversational-b36d84.md","json":"https://newruntime.com/posts/using-a-smart-clip-router-to-benchmark-conversational-b36d84.json"},"markdown_url":"https://newruntime.com/posts/using-a-smart-clip-router-to-benchmark-conversational-b36d84.md","next_reads":[{"type":"topic","path":"/topics/gemini/","url":"https://newruntime.com/topics/gemini/","title":"Gemini","reason":"Explore the gemini topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/gemini.md","json_url":"https://newruntime.com/topics/gemini.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}