{"type":"post","id":"open-sourcing-the-parallel-search-eval-harness-0f53f5","slug":"open-sourcing-the-parallel-search-eval-harness-0f53f5","title":"Open-sourcing the Parallel Search Eval Harness","description":"Parallel has open-sourced the evaluation harness it uses to test Parallel Search, internal models, and its Search Capability Leaderboard.","retrieval_nugget":"Parallel has open-sourced the evaluation harness it uses to test Parallel Search, internal models, and its Search Capability Leaderboard. Teams can run different models and search modes, then replace public benchmark questions with their own. That makes the release useful both as an evaluation tool and as a way to inspect how a search vendor measures its own product.","published_at":"2026-11-17","updated_at":"2026-11-17","record_date":"2026-11-17","date_kind":"published_at","topics":["claude","claude-code","codex"],"entities":["Parallel","Parallel Search","parallel-search-evals","OpenRouter","Claude Code","Codex"],"related_patterns":["agent-economics-moves-to-completed-work"],"novelty_label":"new_fact","what_changed":"Parallel has open-sourced its search evaluation harness, enabling teams to reproduce its benchmarks and run evaluations using their own datasets and model endpoints.","prior_refs":[],"source_url":"https://parallel.ai/blog/parallel-search-eval-harness","source_urls":["https://parallel.ai/blog/parallel-search-eval-harness"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:open-sourcing-the-parallel-search-eval-harness-0f53f5","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/open-sourcing-the-parallel-search-eval-harness-0f53f5/","markdown":"https://newruntime.com/posts/open-sourcing-the-parallel-search-eval-harness-0f53f5.md","json":"https://newruntime.com/posts/open-sourcing-the-parallel-search-eval-harness-0f53f5.json"},"markdown_url":"https://newruntime.com/posts/open-sourcing-the-parallel-search-eval-harness-0f53f5.md","next_reads":[{"type":"topic","path":"/topics/claude/","url":"https://newruntime.com/topics/claude/","title":"Claude","reason":"Explore the claude topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude.md","json_url":"https://newruntime.com/topics/claude.json"},{"type":"topic","path":"/topics/claude-code/","url":"https://newruntime.com/topics/claude-code/","title":"Claude Code","reason":"Explore the claude-code topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude-code.md","json_url":"https://newruntime.com/topics/claude-code.json"},{"type":"topic","path":"/topics/codex/","url":"https://newruntime.com/topics/codex/","title":"Codex","reason":"Explore the codex topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/codex.md","json_url":"https://newruntime.com/topics/codex.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}
