{"type":"post","id":"software-engineering-agents-such-as-agentless-swe-agent-e4c26b","slug":"software-engineering-agents-such-as-agentless-swe-agent-e4c26b","title":"Software-engineering agents such as Agentless, SWE-agent, OpenHands, and Claude Code repeatedly generate five kinds of intermediate information.","description":"Thesis: Intermediate information signals are measurable contributors to repository-level agent success, not merely incidental traces of exploration.","retrieval_nugget":"Thesis: Intermediate information signals are measurable contributors to repository-level agent success, not merely incidental traces of exploration.","published_at":"2026-10-20","updated_at":"2026-10-20","record_date":"2026-10-20","date_kind":"published_at","topics":["claude","claude-code"],"source_urls":["https://arxiv.org/html/2604.07789v3"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:software-engineering-agents-such-as-agentless-swe-agent-e4c26b","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:1dcc063c7f0fa0668b1845a4a25e3f91381c96282d2ece59dd1c2a5518c8f9dd","reviewed_at":"2026-10-20T14:09:03.498Z","source_evidence_count":1,"verified_claim_count":3,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":3,"implication_count":2,"watch_condition_count":2,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"Intermediate information signals are measurable contributors to repository-level agent success, not merely incidental traces of exploration.","observed_facts":[{"text":"The paper selects five signals: Reproduction Test, Regression Test, Edit Location, Execution Context, and API Usage.","source_urls":["https://arxiv.org/html/2604.07789v3"]},{"text":"It reports the contribution ordering Reproduction Test > Execution Context approximately equal to API Usage > Edit Location > Regression Test.","source_urls":["https://arxiv.org/html/2604.07789v3"]},{"text":"The authors compare agent-extracted signals with oracle counterparts and quantify the gap between them.","source_urls":["https://arxiv.org/html/2604.07789v3"]}],"mechanism":"The researchers provide oracle or stronger-agent-extracted signals to a main agent as if they came from a sub-agent or workflow stage, then use resulting task-success gains to estimate signal contribution.","why_now":"Repository-level agents depend on exploration, localization, API retrieval, and testing before editing, while these capabilities can be studied through concrete signals rather than inferred only from an end result.","implications":["Teams can instrument and evaluate intermediate information stages alongside patch correctness.","The reported ordering can motivate local experiments, but should not be assumed universal."],"evidence_boundary":"The findings are experimental results from the paper’s methodology and tasks; they do not establish a universal ranking across agents, benchmarks, or production repositories.","watch_conditions":["Whether evaluations on other benchmarks and agent setups reproduce the reported ordering.","Whether agent-extracted signals close the measured gap with oracle signals."],"related_records":[],"new_branch_reason":"No prior New Runtime record was supplied for this research result, so it begins a distinct analytical record about measuring intermediate information signals in software-engineering agents."},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/software-engineering-agents-such-as-agentless-swe-agent-e4c26b/","markdown":"https://newruntime.com/posts/software-engineering-agents-such-as-agentless-swe-agent-e4c26b.md","json":"https://newruntime.com/posts/software-engineering-agents-such-as-agentless-swe-agent-e4c26b.json"},"related_patterns":["ai-engineering-evaluations-are-splitting-into-task-specific"],"next_reads":[{"type":"topic","path":"/topics/claude/","url":"https://newruntime.com/topics/claude/","title":"Claude","reason":"Explore the claude topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude.md","json_url":"https://newruntime.com/topics/claude.json"},{"type":"topic","path":"/topics/claude-code/","url":"https://newruntime.com/topics/claude-code/","title":"Claude Code","reason":"Explore the claude-code topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude-code.md","json_url":"https://newruntime.com/topics/claude-code.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}