Field noteOct 23, 20261 min read1 source

Getting the Source Right, Not Just the Fact: Source-Aware Verification for MCP Agents

In one minute

Multiverse Computing published ProvenanceGuard, a post-generation verification layer for MCP-based LLM agents.

What changed: Introduces ProvenanceGuard, a source-aware verifier for MCP agents that detects claims attributed to the wrong tool output.

The method keeps tool-output source IDs separate rather than pooling evidence, then decomposes an answer into claims, routes each claim to a source, checks support and attribution, and returns per-claim verdicts plus an allow-or-block decision.

The reported evaluation used 281 traces from a medical agent. Human experts reviewed 361 claims from 40 held-out answers: 139 claims were judged unsuitable to pass, and ProvenanceGuard caught 138; it also held 67 claims the experts judged supported. For claims with an identifiable source, the article reports about 86% exact-source selection. On a 50-case controlled attribution-swap test, it detected all swaps.

The local experimental configuration used MiniLM for source routing, a DeBERTa NLI model for support checks, and a local language model for claim decomposition. The article reports roughly half a second of overhead per answer. It does not establish performance on production deployments, hosted-model configurations, or domains beyond the reported medical-agent tests; it also reports 50.3% exact-source identification in a harder similar-source test.

Evidence / sources

  1. 1huggingface.co/blog/MultiverseComputingCAI/getting-the-source-right-not-just-the-fact-source
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicMcpExplore the mcp topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract