{"type":"post","id":"code-and-dataset-released-at-anonymous-4open-science-41b622","slug":"code-and-dataset-released-at-anonymous-4open-science-41b622","title":"Code and dataset released at anonymous.4open.science; paper on arXiv.","description":"ImplicitBBQ is a question-answering benchmark for testing whether language models respond differently when demographic identity is conveyed through associated characteristics rather than stated directly.","retrieval_nugget":"ImplicitBBQ is a question-answering benchmark for testing whether language models respond differently when demographic identity is conveyed through associated characteristics rather than stated directly. Its authors report a large implicit-versus-explicit bias gap in open-weight models, giving model teams a structured way to test a failure mode that direct-identity evaluations can miss.","published_at":"2026-11-12","updated_at":"2026-11-12","record_date":"2026-11-12","date_kind":"published_at","topics":["models"],"entities":["ImplicitBBQ","Bhaskara Hanuma Vedula","Darshan Anghan","Ishita Goyal","Ponnurangam Kumaraguru","Abhijnan Chakraborty"],"related_patterns":["ai-engineering-evaluations-are-splitting-into-task-specific"],"novelty_label":"new_fact","what_changed":"ImplicitBBQ introduces a benchmark for implicit bias across six demographic dimensions and releases its code and dataset; its evaluation finds substantially higher bias in ambiguous contexts.","prior_refs":[],"source_url":"https://arxiv.org/abs/2604.01925","source_urls":["https://arxiv.org/abs/2604.01925"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:code-and-dataset-released-at-anonymous-4open-science-41b622","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/code-and-dataset-released-at-anonymous-4open-science-41b622/","markdown":"https://newruntime.com/posts/code-and-dataset-released-at-anonymous-4open-science-41b622.md","json":"https://newruntime.com/posts/code-and-dataset-released-at-anonymous-4open-science-41b622.json"},"markdown_url":"https://newruntime.com/posts/code-and-dataset-released-at-anonymous-4open-science-41b622.md","next_reads":[{"type":"topic","path":"/topics/models/","url":"https://newruntime.com/topics/models/","title":"Models","reason":"Explore the models topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/models.md","json_url":"https://newruntime.com/topics/models.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}