{"type":"post","id":"zapier-s-automationbench-joins-fireworks-specialized-intelligence-index-11f11f","slug":"zapier-s-automationbench-joins-fireworks-specialized-intelligence-index-11f11f","title":"Zapier's AutomationBench joins Fireworks' Specialized Intelligence Index; best model completes 51.3% of business workflows","description":"Zapier’s AutomationBench has joined Fireworks’ Specialized Intelligence Index, adding end-to-end business automation to a shared model-comparison surface.","retrieval_nugget":"Zapier’s AutomationBench has joined Fireworks’ Specialized Intelligence Index, adding end-to-end business automation to a shared model-comparison surface. Its headline result is sobering for teams deploying agents: the leading listed model completes 51.3% of private, outcome-checked workflows, making post-action verification a design requirement rather than a polish item.","published_at":"2026-10-28","updated_at":"2026-10-28","record_date":"2026-10-28","date_kind":"published_at","topics":["claude","gemini"],"entities":["Zapier","AutomationBench","Fireworks","Specialized Intelligence Index","Gemini 4 Argon","Claude Sonnet 5.5","GPT-6 Sol","DeepSeek V4 Flash"],"related_patterns":["harness-architecture-outlives-model-choice","verification-bandwidth-is-the-scarce-resource"],"novelty_label":"new_fact","what_changed":"Zapier’s AutomationBench joins the index, adding end-to-end business workflow evaluation; its best model completes 51.3% of workflows.","prior_refs":["memory:eafee5c5-2ddb-8391-a262-f22b328de612","memory:32f171ff-b7fe-83a3-ade3-f766f4dc52a3"],"source_url":"https://zapier.com/blog/automationbench-on-specialized-intelligence-index","source_urls":["https://zapier.com/blog/automationbench-on-specialized-intelligence-index"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:zapier-s-automationbench-joins-fireworks-specialized-intelligence-index-11f11f","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/zapier-s-automationbench-joins-fireworks-specialized-intelligence-index-11f11f/","markdown":"https://newruntime.com/posts/zapier-s-automationbench-joins-fireworks-specialized-intelligence-index-11f11f.md","json":"https://newruntime.com/posts/zapier-s-automationbench-joins-fireworks-specialized-intelligence-index-11f11f.json"},"next_reads":[{"type":"topic","path":"/topics/claude/","url":"https://newruntime.com/topics/claude/","title":"Claude","reason":"Explore the claude topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude.md","json_url":"https://newruntime.com/topics/claude.json"},{"type":"topic","path":"/topics/gemini/","url":"https://newruntime.com/topics/gemini/","title":"Gemini","reason":"Explore the gemini topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/gemini.md","json_url":"https://newruntime.com/topics/gemini.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}