{"type":"post","id":"aa-3d-ranks-21-models-by-human-votes-ae34ef","slug":"aa-3d-ranks-21-models-by-human-votes-ae34ef","title":"AA-3D ranks 21 models by human votes on interactive three.js scenes built from 55 written briefs .","description":"**Thesis:** AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy.","retrieval_nugget":"**Thesis:** AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy.","published_at":"2026-10-13","updated_at":"2026-10-13","record_date":"2026-10-13","date_kind":"published_at","topics":[],"source_urls":["https://artificialanalysis.ai/articles/aa-3d"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:aa-3d-ranks-21-models-by-human-votes-ae34ef","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:7737ebe066f1332f5a09f4bf216985324eedfa1e4357e7e91b504e985ed79c9a","reviewed_at":"2026-10-13T02:02:47.747Z","source_evidence_count":1,"verified_claim_count":4,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":4,"implication_count":1,"watch_condition_count":1,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy.","observed_facts":[{"text":"Artificial Analysis reports a v1.0 evaluation of 21 models across 55 written briefs.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]},{"text":"Each model works in an offline sandbox and returns an index.html scene; the run is capped at three hours or 250 turns.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]},{"text":"Human raters compare pairs of scenes for the same brief without knowing their authors, and the ranking uses Elo.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]},{"text":"Claude Sonnet 5.5 leads at 1194, while the top four are described as statistically tied because their 95% confidence intervals overlap.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]}],"mechanism":"The shared brief and delivery contract create comparable outputs, while blinded pairwise votes capture human preference across whole scenes.","why_now":"As models are asked to build usable interactive experiences, a benchmark needs to test the artifact people encounter, not only the intermediate code.","implications":["Teams evaluating generative 3D workflows can use task-specific preference evidence to compare systems, while treating the ranking as bounded to this benchmark."],"evidence_boundary":"AA-3D reports results from its own 55-brief v1.0 setup; these are not a universal measure of model quality.","watch_conditions":["Watch whether later benchmark versions expand the brief set and report uncertainty or repeatability in enough detail to show whether rank differences persist."],"related_records":[],"new_branch_reason":"No earlier New Runtime record was supplied; this begins a distinct record on artifact-level preference evaluation for interactive 3D generation."},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/aa-3d-ranks-21-models-by-human-votes-ae34ef/","markdown":"https://newruntime.com/posts/aa-3d-ranks-21-models-by-human-votes-ae34ef.md","json":"https://newruntime.com/posts/aa-3d-ranks-21-models-by-human-votes-ae34ef.json"},"next_reads":[{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}