{"type":"raw_signal","id":"kaggle-and-rehearsals-launched-human-behavior-bench-scoring-4d93b6","slug":"kaggle-and-rehearsals-launched-human-behavior-bench-scoring-4d93b6","title":"Kaggle and Rehearsals launched Human Behavior Bench, scoring LLMs on predicting real human survey distributions.","description":"Rehearsals, Google DeepMind and Kaggle have introduced Human Behavior Bench, a benchmark for predicting real human survey-response distributions for defined audiences.","retrieval_nugget":"Rehearsals, Google DeepMind and Kaggle have introduced Human Behavior Bench, a benchmark for predicting real human survey-response distributions for defined audiences.","observed_at":"2026-10-21","record_date":"2026-10-21","date_kind":"observed_at","why_it_matters":"In the published results, six language models score between 76.2 and 80.6 distribution-agreement points. Rehearsals reports 94.1 for its Engram 1.0 system. The source says base models ran through a Kaggle harness, while Engram was assessed using Rehearsals' in-house harness with the same case and metric setup. The authors also report that LLMs select the top answer correctly 41% of the time on pro","novelty":"notable","verification_level":"source-linked","signal_type":"release","source_platform":"runrehearsals.com","topics":["google"],"entities":["Rehearsals","Google DeepMind","Kaggle","Human Behavior Bench","Engram"],"related_patterns":[],"novelty_label":"new_fact","what_changed":"Rehearsals, Google DeepMind and Kaggle introduce a distinct benchmark for predicting human survey-response distributions, reporting 94.1% distribution agreement.","prior_refs":["memory:7df0c1bd-43e6-859f-a008-8709f5030dc9","memory:e752bf6c-a186-8692-af09-0a10f86e07b2"],"source_url":"https://www.runrehearsals.com/human-behavior-bench","source_urls":["https://www.runrehearsals.com/human-behavior-bench"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"signal:kaggle-and-rehearsals-launched-human-behavior-bench-scoring-4d93b6","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/signals/kaggle-and-rehearsals-launched-human-behavior-bench-scoring-4d93b6/","markdown":"https://newruntime.com/signals/kaggle-and-rehearsals-launched-human-behavior-bench-scoring-4d93b6.md","json":"https://newruntime.com/signals/kaggle-and-rehearsals-launched-human-behavior-bench-scoring-4d93b6.json"},"next_reads":[{"type":"topic","path":"/topics/google/","url":"https://newruntime.com/topics/google/","title":"Google","reason":"Explore the google topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/google.md","json_url":"https://newruntime.com/topics/google.json"},{"type":"collection","path":"/signals/","url":"https://newruntime.com/signals/","title":"Raw Signals","reason":"Open every source-linked raw signal.","media_type":"text/html","json_url":"https://newruntime.com/signals.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}
