{"type":"raw_signal","id":"basket-2459512c-34","slug":"agent-evaluation-control-stack-roundup","title":"Agent Evaluation Is Becoming a Control Stack","description":"New engineering and research material connects repeatable tasks, trajectory review, public eval validation, and misalignment checks.","retrieval_nugget":"New engineering and research material connects repeatable tasks, trajectory review, public eval validation, and misalignment checks. Agent evaluation is becoming a control stack that surrounds execution rather than a score attached after the fact.","observed_at":"2026-08-28","record_date":"2026-08-28","date_kind":"observed_at","why_it_matters":"The operational consequence is to treat eval artifacts as production infrastructure. Preserve the task version, environment, model, tools, evidence, and failure category. A benchmark gain is trustworthy only within that contract, and a passing score should not grant an agent broader authority than the evaluated environment.","novelty":"structural","verification_level":"source-linked","signal_type":"roundup","source_platform":"developers.openai.com","topics":["agents","evals","safety"],"entities":[],"related_patterns":[],"source_url":"https://developers.openai.com/blog/automating-repetitive-work-at-openai-with-codex","source_urls":["https://developers.openai.com/blog/automating-repetitive-work-at-openai-with-codex","https://airbnb.tech/ai-ml/eval-driven-development-lessons-from-evaluating-genai-at-scale","https://alignment.openai.com/validating-public-evals","https://alignment.openai.com/accidental-cot-grading"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"signal:agent-evaluation-control-stack-roundup","status":"published","visuals":[],"routes":{"html":"https://newruntime.com/signals/agent-evaluation-control-stack-roundup/","markdown":"https://newruntime.com/signals/agent-evaluation-control-stack-roundup.md","json":"https://newruntime.com/signals/agent-evaluation-control-stack-roundup.json"}}