Anthropic Moves Large Tool Libraries Out Of Context

Anthropic's Tool Search Tool, Programmatic Tool Calling, and Tool Use Examples separate discovery, orchestration, and usage guidance for agents with large tool libraries.

Retrieval answer

Anthropic's Tool Search Tool, Programmatic Tool Calling, and Tool Use Examples separate discovery, orchestration, and usage guidance for agents with large tool libraries. Anthropic's advanced tool-use release addresses three separate failure modes that appear when an agent connects to dozens of systems. First, tool definitions consume context before work begins.

New Runtime synthesiseditorial-diagram
Hand-drawn tool architecture where a compact search index reveals a few relevant tools, code orchestrates them, and only final results enter model context.
Anthropic splits large-tool agent work into on-demand discovery, code-based orchestration, and example-backed usage.New Runtime synthesis from Anthropic EngineeringOriginal source ↗
  1. DiscoverThe agent searches a compact index and expands only the relevant tool definitions.
  2. OrchestrateCode handles loops, conditions, transformations, and intermediate results outside model context.
  3. DemonstrateExamples teach valid usage patterns that a JSON schema cannot express.

Anthropic’s advanced tool-use release addresses three separate failure modes that appear when an agent connects to dozens of systems.

First, tool definitions consume context before work begins. Anthropic’s example combines GitHub, Slack, Sentry, Grafana, and Splunk into 58 tools and roughly 55,000 tokens of definitions. The company says it has observed 134,000 tokens of tool definitions in larger setups. Similar names then make selection harder, not easier.

The Tool Search Tool changes the loading model. Developers can mark tools or whole MCP servers with defer_loading: true. Claude starts with the search capability and a few essential tools, then expands only the definitions needed for the task. Anthropic reports an 85% reduction in tool-definition token use in one internal setup, alongside better MCP evaluation accuracy for Opus models.

Second, Programmatic Tool Calling lets Claude express orchestration as code. Loops, conditions, joins, and data transformations run in a code-execution environment. Large intermediate tool results are processed there, and only the compact output returns to model context. That avoids a full model round trip for every mechanical step.

Third, Tool Use Examples cover semantics that schemas miss. A JSON schema can say an optional field is valid. It cannot reliably teach when the field should be used, which parameter combinations are conventional, or what an API expects in a real workflow.

The combined pattern is stronger than adding a larger context window. Keep discovery cheap, orchestration explicit, and examples close to the tool contract. Load tokens only when the current task proves they are necessary.

Recommendation

Anthropic's Tool Search Tool, Programmatic Tool Calling, and Tool Use Examples separate discovery, orchestration, and usage guidance for agents with large tool libraries.

Discovery graph / next reads

Continue through New Runtime

Open the graph
  1. 01topicContext engineering - New RuntimeExplore the context engineering topic hub.
  2. 02topicMCP - New RuntimeExplore the mcp topic hub.
  3. 03related materialChatGPT Cuts Repeated Work Across The Agent StackShares agent harnesses and context engineering.
  4. 04related materialCline Hooks Put Deterministic Rules Inside The Agent LoopShares agent harnesses and mcp.
  5. 05related materialDr. Skill Audits What An Agent Loads Before It WorksShares context engineering and mcp.

These links are also published in this page’s JSON twin and as typed edges in DiscoveryGraph v1.

Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate…

Open the JSON contract