{"type":"post","id":"vibe-physics-the-ai-grad-student-analysis-6290b9","slug":"vibe-physics-the-ai-grad-student-analysis-6290b9","title":"Vibe physics: The AI grad student","description":"Thesis: This case shows a domain expert using Claude as a supervised executor for a bounded, checkable theoretical-physics calculation, not as an autonomous scientist.","retrieval_nugget":"Thesis: This case shows a domain expert using Claude as a supervised executor for a bounded, checkable theoretical-physics calculation, not as an autonomous scientist.","published_at":"2026-10-02","updated_at":"2026-10-02","record_date":"2026-10-02","date_kind":"published_at","topics":["claude"],"source_urls":["https://www.anthropic.com/research/vibe-physics"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:vibe-physics-the-ai-grad-student-analysis-6290b9","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:7970c282b2de1eddd738b41052d24eec11e1335b1400feaaadae294f69b212c8","reviewed_at":"2026-10-02T14:03:52.276Z","source_evidence_count":1,"verified_claim_count":2,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":2,"implication_count":1,"watch_condition_count":1,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"This case shows a domain expert using Claude as a supervised executor for a bounded, checkable theoretical-physics calculation, not as an autonomous scientist.","observed_facts":[{"text":"Harvard professor Matthew Schwartz says he supervised Claude Opus 4.5 on resumming the Sudakov shoulder in the C-parameter distribution.","source_urls":["https://www.anthropic.com/research/vibe-physics"]},{"text":"He reports that the work took two weeks rather than the usual year and involved more than 110 drafts, 36 million tokens, and over 40 hours of local CPU compute.","source_urls":["https://www.anthropic.com/research/vibe-physics"]}],"mechanism":"Schwartz deliberately selected a well-defined, graduate-level problem with established methods and a result he could check. That structure let him decompose the work into prompts, inspect intermediate outputs, and correct errors. The reported speedup therefore depends on expert task selection and continuous evaluation; it is not evidence that a model independently identifies worthwhile questions, validates its own reasoning, or completes open-ended research.","why_now":"The account offers a concrete example amid claims about end-to-end AI scientists, and Schwartz explicitly argues that intermediate, supervised steps matter. Its most useful contribution is a description of a workflow and its limits, rather than proof of generalized scientific autonomy.","implications":["For technical research, the near-term opportunity may be to accelerate execution on bounded problems while keeping scientific judgment with domain experts."],"evidence_boundary":"These figures and judgments come from Schwartz’s first-person account published by Anthropic; the supplied source provides no independent replication or comparative evaluation.","watch_conditions":["Watch for independent replications that report comparable task difficulty, expert time, error rates, and validation outcomes."],"related_records":[],"new_branch_reason":"No prior New Runtime record is supplied; this begins a distinct analytical record of the supervised theoretical-physics experiment documented in the verified source."},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/vibe-physics-the-ai-grad-student-analysis-6290b9/","markdown":"https://newruntime.com/posts/vibe-physics-the-ai-grad-student-analysis-6290b9.md","json":"https://newruntime.com/posts/vibe-physics-the-ai-grad-student-analysis-6290b9.json"},"next_reads":[{"type":"topic","path":"/topics/claude/","url":"https://newruntime.com/topics/claude/","title":"Claude","reason":"Explore the claude topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude.md","json_url":"https://newruntime.com/topics/claude.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}
