{"type":"post","id":"search-capability-leaderboard-24-models-ranked-on-web-8a7b71","slug":"search-capability-leaderboard-24-models-ranked-on-web-8a7b71","title":"Search Capability Leaderboard: 24 models ranked on web search","description":"The new leaderboard makes web-search competence a separately visible model-selection variable rather than a hidden assumption inside general capability rankings.","retrieval_nugget":"The new leaderboard makes web-search competence a separately visible model-selection variable rather than a hidden assumption inside general capability rankings.","published_at":"2026-09-25","updated_at":"2026-09-25","record_date":"2026-09-25","date_kind":"published_at","topics":[],"source_urls":["https://parallel.ai/blog/search-leaderboard"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:search-capability-leaderboard-24-models-ranked-on-web-8a7b71","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:5d57535396d6d57f9e47aa96e7850f0cf46d114d842253001fd65fc71baa1fd3","reviewed_at":"2026-09-25T09:00:58.354Z","source_evidence_count":1,"verified_claim_count":3,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":3,"implication_count":2,"watch_condition_count":2,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"The new leaderboard makes web-search competence a separately visible model-selection variable rather than a hidden assumption inside general capability rankings.","observed_facts":[{"text":"Parallel launched a Search Capability Leaderboard evaluating 24 popular open- and closed-source models used with web search.","source_urls":["https://parallel.ai/blog/search-leaderboard"]},{"text":"Parallel defines Search Intelligence Score as accuracy across three existing public benchmark suites and ranks Search Efficiency by cost among models meeting or exceeding median accuracy.","source_urls":["https://parallel.ai/blog/search-leaderboard"]},{"text":"Parallel’s September 15, 2026 snapshot reports GPT-6 (Astra) at 70.3 Search Intelligence and $301 per 1,000 tasks, while GPT-5.6 Luna leads its efficiency ranking at 55.0 and $23 per 1,000 tasks.","source_urls":["https://parallel.ai/blog/search-leaderboard"]}],"mechanism":"Search performance is composite: a model must decide when more evidence is required, formulate useful queries, select and inspect relevant URLs, and synthesize supported answers. Holding the search layer constant is meant to isolate the model’s contribution to those choices; separating accuracy from cost then turns deployment into a threshold-and-budget decision.","why_now":"This matters now because agents increasingly use web research as an operational dependency, while model reports and search-provider comparisons do not consistently expose this interaction.","implications":["A first implication is that teams building search-heavy agents should benchmark the model-and-search combination, not select a model solely from general-purpose leaderboards.","A second implication is that an accuracy target can be a more useful procurement constraint than an abstract preference for the top score."],"evidence_boundary":"The evidence is limited to Parallel’s published methodology, selected public benchmark suites, and its September 15, 2026 snapshot; it does not independently establish performance on every production workflow or prove that the ranking will persist as models, prices, prompts, and search behavior change.","watch_conditions":["Watch whether Parallel publishes task-level methodology, benchmark composition, reproducible runs, and updates that show how rankings move as model versions and pricing change.","Also watch whether other evaluators adopt comparable model-plus-search measurements, which would test whether this framing generalizes beyond one provider’s harness."],"related_records":[],"new_branch_reason":"This begins a distinct analytical record because no prior New Runtime record was supplied for this specific public leaderboard launch and its model-plus-search evaluation framing."},"routes":{"html":"https://newruntime.com/posts/search-capability-leaderboard-24-models-ranked-on-web-8a7b71/","markdown":"https://newruntime.com/posts/search-capability-leaderboard-24-models-ranked-on-web-8a7b71.md","json":"https://newruntime.com/posts/search-capability-leaderboard-24-models-ranked-on-web-8a7b71.json"},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"next_reads":[{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}