{"type":"raw_signal","id":"rcp-ndcg-10-a-new-approach-to-enterprise-4733cc","slug":"rcp-ndcg-10-a-new-approach-to-enterprise-4733cc","title":"RCP-nDCG@10: A New Approach to Enterprise Retrieval Quality","description":"Cohere has introduced Rubric-Calibrated Preferences nDCG@10 (RCP-nDCG@10), a retrieval evaluation method that scores retrieved documents against a shared relevance rubric using a calibrated AI judge, rather than relying only on pre-existing relevance labels.","retrieval_nugget":"Cohere has introduced Rubric-Calibrated Preferences nDCG@10 (RCP-nDCG@10), a retrieval evaluation method that scores retrieved documents against a shared relevance rubric using a calibrated AI judge, rather than relying only on pre-existing relevance labels.","observed_at":"2026-09-30","record_date":"2026-09-30","date_kind":"observed_at","why_it_matters":"In a blind human study reported by Cohere, 46 annotators reviewed results from NanoBEIR, BRIGHT, and ViDoRe v3. Across 289 head-to-head contests covering 273 queries, RCP-nDCG selected the system preferred by reviewers 77% of the time, compared with 52% for conventional nDCG. The company also reports that where the two metrics named different winners, reviewers sided with RCP-nDCG 70% of the time.","novelty":"notable","verification_level":"source-linked","signal_type":"research","source_platform":"cohere.com","topics":[],"entities":[],"related_patterns":[],"source_url":"https://cohere.com/blog/rcp-ndcg","source_urls":["https://cohere.com/blog/rcp-ndcg"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"signal:rcp-ndcg-10-a-new-approach-to-enterprise-4733cc","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/signals/rcp-ndcg-10-a-new-approach-to-enterprise-4733cc/","markdown":"https://newruntime.com/signals/rcp-ndcg-10-a-new-approach-to-enterprise-4733cc.md","json":"https://newruntime.com/signals/rcp-ndcg-10-a-new-approach-to-enterprise-4733cc.json"},"next_reads":[{"type":"collection","path":"/signals/","url":"https://newruntime.com/signals/","title":"Raw Signals","reason":"Open every source-linked raw signal.","media_type":"text/html","json_url":"https://newruntime.com/signals.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}