{"type":"raw_signal","id":"benchmark-grades-mergeability-using-rubrics-from-20-open-cfc01f","slug":"benchmark-grades-mergeability-using-rubrics-from-20-open-cfc01f","title":"Benchmark grades mergeability using rubrics from 20+ open-source maintainers , not just unit tests.","description":"Cognition has introduced FrontierCode, a benchmark intended to measure whether coding models produce changes maintainers would consider mergeable, not merely code that passes tests.","retrieval_nugget":"Cognition has introduced FrontierCode, a benchmark intended to measure whether coding models produce changes maintainers would consider mergeable, not merely code that passes tests.","observed_at":"2026-10-12","record_date":"2026-10-12","date_kind":"observed_at","why_it_matters":"Cognition has introduced FrontierCode, a benchmark intended to measure whether coding models produce changes maintainers would consider mergeable, not merely code that passes tests. The company says the benchmark was built with maintainers of 36 open-source repositories, with more than 40 hours invested per task. Its criteria cover correctness, test quality, scope discipline, style, and repository","novelty":"notable","verification_level":"source-linked","signal_type":"release","source_platform":"cognition.com","topics":[],"entities":["Cognition","FrontierCode","Claude Opus 4.8","SWE-Bench Pro","Kimi K2.6"],"related_patterns":[],"source_url":"https://cognition.com/blog/frontier-code","source_urls":["https://cognition.com/blog/frontier-code"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"signal:benchmark-grades-mergeability-using-rubrics-from-20-open-cfc01f","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/signals/benchmark-grades-mergeability-using-rubrics-from-20-open-cfc01f/","markdown":"https://newruntime.com/signals/benchmark-grades-mergeability-using-rubrics-from-20-open-cfc01f.md","json":"https://newruntime.com/signals/benchmark-grades-mergeability-using-rubrics-from-20-open-cfc01f.json"},"next_reads":[{"type":"collection","path":"/signals/","url":"https://newruntime.com/signals/","title":"Raw Signals","reason":"Open every source-linked raw signal.","media_type":"text/html","json_url":"https://newruntime.com/signals.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}