---
type: "post"
id: "artificial-analysis-launched-aa-personalitybench-scoring-36-llms-01939f"
slug: "artificial-analysis-launched-aa-personalitybench-scoring-36-llms-01939f"
title: "Artificial Analysis launched AA-PersonalityBench , scoring 36 LLMs on personality and communication style."
description: "Communication style is becoming a separately measured model-evaluation dimension, distinct from correctness and capability."
retrieval_nugget: "Communication style is becoming a separately measured model-evaluation dimension, distinct from correctness and capability."
published_at: "2026-10-20"
updated_at: "2026-10-20"
record_date: "2026-10-20"
date_kind: "published_at"
topics: ["evals","models"]
source_urls: ["https://artificialanalysis.ai/evaluations/aa-personalitybench"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:artificial-analysis-launched-aa-personalitybench-scoring-36-llms-01939f"
status: "published"
visuals: []
editorial_provenance: {"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:8dd3cc7ca82bba2bf8a30bf07d619c6714da0390cfa3937eeabc78de3b5ad219","reviewed_at":"2026-10-20T05:01:58.973Z","source_evidence_count":1,"verified_claim_count":3,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":3,"implication_count":1,"watch_condition_count":1,"related_record_count":0}
analysis: {"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"Communication style is becoming a separately measured model-evaluation dimension, distinct from correctness and capability.","observed_facts":[{"text":"The public page describes 30 personality traits, grouped into eight indexes, and 21 directly measured communication characteristics.","source_urls":["https://artificialanalysis.ai/evaluations/aa-personalitybench"]},{"text":"Artificial Analysis says each trait uses 30 prompts, 900 total, with pairwise LLM-judge comparisons converted into Bradley-Terry Elo ratings.","source_urls":["https://artificialanalysis.ai/evaluations/aa-personalitybench"]},{"text":"The public page displays “10 of 38 models,” while the supplied launch description says 36 LLMs.","source_urls":["https://artificialanalysis.ai/evaluations/aa-personalitybench"]}],"mechanism":"Pairwise LLM-judge comparisons yield Elo ratings for traits; normalized trait scores are aggregated into eight indexes, while 21 response characteristics are measured directly.","why_now":"Model selection increasingly includes user-facing interaction quality alongside task capability, creating demand for comparable style measurements.","implications":["Teams can include communication preferences as one model-selection dimension, without treating style scores as a proxy for task performance."],"evidence_boundary":"The public description gives the benchmark method and displayed counts, but does not establish predictive validity for user outcomes or stability across contexts; its displayed count differs from the supplied launch description.","watch_conditions":["The first watch condition is whether Artificial Analysis clarifies the model count and publishes evidence that style rankings generalize across tasks and settings."],"related_records":[],"new_branch_reason":"No prior New Runtime record is supplied for this benchmark launch; this is a distinct record about external measurement of model communication style."}
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/artificial-analysis-launched-aa-personalitybench-scoring-36-llms-01939f/","markdown":"https://newruntime.com/posts/artificial-analysis-launched-aa-personalitybench-scoring-36-llms-01939f.md","json":"https://newruntime.com/posts/artificial-analysis-launched-aa-personalitybench-scoring-36-llms-01939f.json"}
related_patterns: ["ai-engineering-evaluations-are-splitting-into-task-specific"]
---

# Artificial Analysis launched AA-PersonalityBench , scoring 36 LLMs on personality and communication style.

## Retrieval answer

Communication style is becoming a separately measured model-evaluation dimension, distinct from correctness and capability.

Communication style is becoming a separately measured model-evaluation dimension, distinct from correctness and capability. Artificial Analysis has launched AA-PersonalityBench to compare how models communicate, not whether their answers are correct. The public page describes 30 personality traits grouped into eight indexes and 21 directly measured communication characteristics.

Pairwise LLM-judge comparisons yield Elo ratings for traits; normalized trait scores are aggregated into eight indexes, while 21 response characteristics are measured directly. The source says each trait uses 30 prompts across 30 traits, 900 total, and that verdicts become Bradley-Terry Elo ratings. This turns style into a reported evaluation dimension rather than an informal impression. Model selection increasingly includes user-facing interaction quality alongside task capability, creating demand for comparable style measurements.

Teams can include communication preferences as one model-selection dimension, without treating style scores as a proxy for task performance. The public description gives the benchmark method and displayed counts, but does not establish predictive validity for user outcomes or stability across contexts; its displayed count differs from the supplied launch description. The first watch condition is whether Artificial Analysis clarifies the model count and publishes evidence that style rankings generalize across tasks and settings. The public page displays “10 of 38 models,” while the supplied launch description says 36 LLMs; that discrepancy merits clarification, not speculation about its cause.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Evals](https://newruntime.com/topics/evals.md): Explore the evals topic hub.
- topic hub: [Models](https://newruntime.com/topics/models.md): Explore the models topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)