---
type: "post"
id: "aa-3d-ranks-21-models-by-human-votes-ae34ef"
slug: "aa-3d-ranks-21-models-by-human-votes-ae34ef"
title: "AA-3D ranks 21 models by human votes on interactive three.js scenes built from 55 written briefs ."
description: "**Thesis:** AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy."
retrieval_nugget: "**Thesis:** AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy."
published_at: "2026-10-13"
updated_at: "2026-10-13"
record_date: "2026-10-13"
date_kind: "published_at"
topics: []
source_urls: ["https://artificialanalysis.ai/articles/aa-3d"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:aa-3d-ranks-21-models-by-human-votes-ae34ef"
status: "published"
visuals: []
editorial_provenance: {"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:7737ebe066f1332f5a09f4bf216985324eedfa1e4357e7e91b504e985ed79c9a","reviewed_at":"2026-10-13T02:02:47.747Z","source_evidence_count":1,"verified_claim_count":4,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":4,"implication_count":1,"watch_condition_count":1,"related_record_count":0}
analysis: {"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy.","observed_facts":[{"text":"Artificial Analysis reports a v1.0 evaluation of 21 models across 55 written briefs.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]},{"text":"Each model works in an offline sandbox and returns an index.html scene; the run is capped at three hours or 250 turns.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]},{"text":"Human raters compare pairs of scenes for the same brief without knowing their authors, and the ranking uses Elo.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]},{"text":"Claude Sonnet 5.5 leads at 1194, while the top four are described as statistically tied because their 95% confidence intervals overlap.","source_urls":["https://artificialanalysis.ai/articles/aa-3d"]}],"mechanism":"The shared brief and delivery contract create comparable outputs, while blinded pairwise votes capture human preference across whole scenes.","why_now":"As models are asked to build usable interactive experiences, a benchmark needs to test the artifact people encounter, not only the intermediate code.","implications":["Teams evaluating generative 3D workflows can use task-specific preference evidence to compare systems, while treating the ranking as bounded to this benchmark."],"evidence_boundary":"AA-3D reports results from its own 55-brief v1.0 setup; these are not a universal measure of model quality.","watch_conditions":["Watch whether later benchmark versions expand the brief set and report uncertainty or repeatability in enough detail to show whether rank differences persist."],"related_records":[],"new_branch_reason":"No earlier New Runtime record was supplied; this begins a distinct record on artifact-level preference evaluation for interactive 3D generation."}
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/aa-3d-ranks-21-models-by-human-votes-ae34ef/","markdown":"https://newruntime.com/posts/aa-3d-ranks-21-models-by-human-votes-ae34ef.md","json":"https://newruntime.com/posts/aa-3d-ranks-21-models-by-human-votes-ae34ef.json"}
---

# AA-3D ranks 21 models by human votes on interactive three.js scenes built from 55 written briefs .

## Retrieval answer

**Thesis:** AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy.

**Thesis:** AA-3D makes preference for a completed interactive scene the measured outcome, rather than treating code generation or model identity as a sufficient proxy.

**Observed facts:** Artificial Analysis reports a v1.0 evaluation of 21 models across 55 written briefs. Each model works in an offline sandbox and returns an index.html scene; the run is capped at three hours or 250 turns. Human raters compare pairs of scenes for the same brief without knowing their authors, and the ranking uses Elo. Claude Sonnet 5.5 leads at 1194, while the top four are described as statistically tied because their 95% confidence intervals overlap.

**Mechanism:** The shared brief and delivery contract create comparable outputs, while blinded pairwise votes capture human preference across whole scenes. **Why now:** As models are asked to build usable interactive experiences, a benchmark needs to test the artifact people encounter, not only the intermediate code. **First implication:** Teams evaluating generative 3D workflows can use task-specific preference evidence to compare systems, while treating the ranking as bounded to this benchmark.

The article also gives a single-run cost example, but neither that sample nor the ranking establishes broad cost efficiency, reliable performance across all 3D work, or production readiness. **Evidence boundary:** AA-3D reports results from its own 55-brief v1.0 setup; these are not a universal measure of model quality.

**First watch condition:** Watch whether later benchmark versions expand the brief set and report uncertainty or repeatability in enough detail to show whether rank differences persist. With no earlier New Runtime record supplied, this starts a distinct analytical record on artifact-level preference evaluation for interactive 3D generation.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)