Field noteOct 20, 20262 min read1 source

New SciFullBench benchmark provides full-paper queries and candidates from ICLR, NeurIPS, ACL, EMNLP.

In one minute

SciFullBench makes the evaluation object in scientific retrieval more demanding: its query and candidate contexts can be complete papers, not only abstract surrogates.

The paper says the benchmark provides both complete and segmented contexts. Its proposed Chain of Retrieval (CoR) decomposes a query paper into aspect-specific views, matches those views against candidate-paper segments, and iteratively promotes top-ranked results as new queries. The resulting tree is aggregated from descendants toward parent nodes.

Implication: Researchers can evaluate retrieval systems against complete and segmented paper contexts. Agent builders can consider iterative candidate expansion and aggregation beyond one-shot similarity. The authors report that CoR significantly outperforms existing retrieval baselines, but the supplied abstract gives no benchmark size, baseline names, scores, or evaluation protocol.

Thesis

Full-paper retrieval becomes more testable when benchmarks preserve document context and the retrieval process can exploit relations among candidate papers.

Observed facts

  • The abstract says SciFullBench provides both complete and segmented contexts of full papers for queries and candidates.

    1
  • The abstract describes CoR as decomposing query papers into aspect-specific views and matching them against segmented candidate papers.

    1
  • The abstract reports that CoR significantly outperforms existing retrieval baselines.

    1

Mechanism

CoR uses aspect-specific matching to identify candidates, promotes top-ranked results as new queries to iteratively expand search, then aggregates the retrieval tree in post-order.

Why now

The paper identifies abstract-only representations as sparse summaries that miss dynamic relations among relevant papers.

Implications

  1. Researchers can evaluate retrieval systems against complete and segmented paper contexts.

  2. Agent builders can consider iterative candidate expansion and aggregation beyond one-shot similarity.

Evidence boundary

This account rests on the arXiv abstract; it does not establish the magnitude, robustness, or practical generality of the reported gains.

Watch conditions

  1. Check the paper's dataset composition, split design, metrics, and numerical comparisons before treating the reported advantage as a deployment signal.

Evidence / sources

  1. 1arxiv.org/abs/2507.10057
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicRetrievalExplore the retrieval topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract