DeltaSep 28, 20262 min read2 sources

Agents can define document extraction schemas via natural language conversation

LlamaIndex’s Retrieval Harness and Conversational Extract let AI agents traverse, query, and extract data from documents without hand‑written JSON schemas, using plain‑language prompts instead.

In one minute

LlamaIndex’s Retrieval Harness and Conversational Extract let AI agents traverse, query, and extract data from documents without hand‑written JSON schemas, using plain‑language prompts instead. Before: Agents needed manually authored JSON schemas or code to specify how to parse and extract fields from documents. Enabling change: LlamaIndex released Retrieval Harness for filesystem‑style document tools and Conversational Extract that builds extraction schemas

Capability change

  • Before: Agents needed manually authored JSON schemas or code to specify how to parse and extract fields from documents.
  • Enabling change: LlamaIndex released Retrieval Harness for filesystem‑style document tools and Conversational Extract that builds extraction schemas through dialogue.
  • After: Agents can interactively create and run extraction pipelines by describing the desired fields in natural language, enabling on‑the‑fly schema generation.

Human consequence: Developers and analysts spend far less time authoring schema definitions and can prototype document‑processing flows directly in chat.

Bottleneck: Accuracy still depends on LLM understanding of the document structure and on the quality of the underlying parsing models.

Buildability: B3. Verification: source-inspected. Related shift: document-processing-shifts-from-hand-crafted-ocr-pipelines-to-llm.

The simultaneous release of Retrieval Harness and Conversational Extract shows a coordinated push to make document parsing conversational. This removes a long‑standing friction point—hand‑coding schemas—making it feasible to build flexible extraction agents quickly. Builders can now assemble pipelines that let users ask, “Give me the invoice total and date,” and the system will generate the needed schema on the fly. Watch for limits in schema complexity and for edge cases where the LLM misinterprets document layouts, which will drive future improvements in grounding and validation.

Published automatically by the New Runtime weekly knowledge desk from the week's evidence.

Supporting evidence

Provenance

Auto-created by the New Runtime weekly knowledge desk on 2026-09-28 from evidence reviewed in the week of 2026-09-21. It is published through the live overlay and joins the hand-edited catalog at the next release.

Evidence / sources

  1. 1newruntime.com/signals/parse-extract-classify-now-each-with-its-own-86d89a
  2. 2newruntime.com/signals/parse-extract-classify-now-each-with-its-own-ce8423
All Capability Deltas

Next reads

Read next

Open the graph
  1. 01archiveCapability DeltasOpen every observed capability delta.
  2. 02source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract