{"type":"post","id":"snorkel-finds-fable-5-2-pass-1-at-34944d","slug":"snorkel-finds-fable-5-2-pass-1-at-34944d","title":"Snorkel finds Fable 5.2 pass@1 at 71% versus 53% for Fable 5.1 on matched coding tasks","description":"Snorkel AI reports that Fable 5.2 outperformed Fable 5.1 on 26 matched frontier coding tasks, raising pass@1 from 53.1% to 71.4%.","retrieval_nugget":"Snorkel AI reports that Fable 5.2 outperformed Fable 5.1 on 26 matched frontier coding tasks, raising pass@1 from 53.1% to 71.4%. The more consequential change was a shift away from terminal and formatting failures toward errors of planning and task interpretation, which teams cannot assume retries will repair.","published_at":"2026-11-14","updated_at":"2026-11-14","record_date":"2026-11-14","date_kind":"published_at","topics":[],"entities":["Snorkel AI","Fable 5.2","Fable 5.1","Vals"],"related_patterns":[],"novelty_label":"new_fact","what_changed":"Snorkel’s matched-task evaluation reports Fable 5.2 at 71% pass@1 versus 53% for Fable 5.1, with terminal failures nearly disappearing.","prior_refs":["https://newruntime.com/posts/vals-reports-the-clearest-improvement-over-fable-5-fd58c3/"],"source_url":"https://snorkel.ai/blog/fable-5-2-vs-fable-5-1-coding-benchmark","source_urls":["https://snorkel.ai/blog/fable-5-2-vs-fable-5-1-coding-benchmark"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:snorkel-finds-fable-5-2-pass-1-at-34944d","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/snorkel-finds-fable-5-2-pass-1-at-34944d/","markdown":"https://newruntime.com/posts/snorkel-finds-fable-5-2-pass-1-at-34944d.md","json":"https://newruntime.com/posts/snorkel-finds-fable-5-2-pass-1-at-34944d.json"},"markdown_url":"https://newruntime.com/posts/snorkel-finds-fable-5-2-pass-1-at-34944d.md","next_reads":[{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}