Field noteOct 23, 20261 min read1 source

Relevance isn’t enough: what it takes to rerank the web

In one minute

Exa published an evaluation of the reranker used in its production web search.

What changed: The post argues that agent-facing reranking must assess intent, freshness and other dimensions beyond topical relevance, unlike prior Exa search API benchmark coverage.

It compares Exa Reranker Auto and Fast with Cohere Rerank 5, Voyage Rerank 3, and Google Semantic Ranker 5. Exa says its retrieval system searches a pool of more than 100 billion web documents, then reranks a shortlist within hundreds of milliseconds.

The company evaluated seven benchmarks: public BEIR, MIRACL, and MAIR, plus internal coding, navigational, freshness, and authority sets. Each system received the same 50 candidates; Exa reports nDCG@10 with bootstrapped 95% confidence intervals. Its reported seven-benchmark macro scores are 0.738 for Auto and 0.733 for Fast, against 0.711 for Voyage, 0.693 for Cohere Pro, and 0.682 for Google Semantic Ranker.

Results vary by task. On Exa's internal set of 317 coding queries, Voyage and Cohere score above Exa. The company also says competing rerankers lowered the ranking quality of Exa Instant on its navigational tests. Exa does not plan to release a standalone reranking API. The source does not establish independent performance leadership: four benchmarks are internal, and it says some internal labels were produced by GPT-5.4.

Evidence / sources

  1. 1exa.ai/blog/sota-reranking
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicGoogleExplore the google topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract