{"type":"post","id":"frontiercs-2-publishes-evaluation-of-unreleased-gemini-4-bd0aaf","slug":"frontiercs-2-publishes-evaluation-of-unreleased-gemini-4-bd0aaf","title":"FrontierCS 2 publishes evaluation of unreleased Gemini 4 Carbon in Antigravity: 54% pass rate, 52.9 FCI","description":"FrontierCS 2 evaluated Gemini 4 Carbon on 48 software-research tasks in Google Antigravity before Carbon’s public introduction.","retrieval_nugget":"FrontierCS 2 evaluated Gemini 4 Carbon on 48 software-research tasks in Google Antigravity before Carbon’s public introduction. It matched Gemini 4 Argon’s 54% strict pass rate but achieved a higher capability index at roughly twice the estimated per-run cost, while the evaluation also surfaced harness timeout and loophole issues.","published_at":"2026-10-31","updated_at":"2026-10-31","record_date":"2026-10-31","date_kind":"published_at","topics":["gemini","google","claude"],"entities":["FrontierCS 2","Gemini 4 Carbon","Gemini 4 Argon","Google Antigravity","Claude Opus 5.5"],"related_patterns":["harness-architecture-outlives-model-choice","verification-bandwidth-is-the-scarce-resource"],"novelty_label":"new_fact","what_changed":"FrontierCS 2 reports Carbon passed 26/48 tasks (54%) in its Antigravity benchmark, details loophole-based passes and early-stop reruns, and says its mean score where both models submitted exceeded Argon’s.","prior_refs":["memory:73378e24-2008-8341-a0ed-b1e651b514e5","memory:826f755f-3350-813b-ae92-b4222ad3ce2f"],"source_url":"https://frontier-cs.org/blog/gemini-4-carbon","source_urls":["https://frontier-cs.org/blog/gemini-4-carbon"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:frontiercs-2-publishes-evaluation-of-unreleased-gemini-4-bd0aaf","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/frontiercs-2-publishes-evaluation-of-unreleased-gemini-4-bd0aaf/","markdown":"https://newruntime.com/posts/frontiercs-2-publishes-evaluation-of-unreleased-gemini-4-bd0aaf.md","json":"https://newruntime.com/posts/frontiercs-2-publishes-evaluation-of-unreleased-gemini-4-bd0aaf.json"},"next_reads":[{"type":"topic","path":"/topics/gemini/","url":"https://newruntime.com/topics/gemini/","title":"Gemini","reason":"Explore the gemini topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/gemini.md","json_url":"https://newruntime.com/topics/gemini.json"},{"type":"topic","path":"/topics/google/","url":"https://newruntime.com/topics/google/","title":"Google","reason":"Explore the google topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/google.md","json_url":"https://newruntime.com/topics/google.json"},{"type":"topic","path":"/topics/claude/","url":"https://newruntime.com/topics/claude/","title":"Claude","reason":"Explore the claude topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude.md","json_url":"https://newruntime.com/topics/claude.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}