{"type":"post","id":"yukun-huang-sanxing-chen-jian-pei-manzil-zaheer-eea460","slug":"yukun-huang-sanxing-chen-jian-pei-manzil-zaheer-eea460","title":"Yukun Huang, Sanxing Chen, Jian Pei, Manzil Zaheer, and Bhuwan Dhingra describe the method in their paper .","description":"**Thesis:** CitePretrain shifts citation attribution work from answer-time retrieval into continual pretraining, but its citations are bounded by the documents indexed during training.","retrieval_nugget":"**Thesis:** CitePretrain shifts citation attribution work from answer-time retrieval into continual pretraining, but its citations are bounded by the documents indexed during training.","published_at":"2026-10-16","updated_at":"2026-10-16","record_date":"2026-10-16","date_kind":"published_at","topics":["retrieval"],"source_urls":["https://arxiv.org/html/2506.17585v4"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:yukun-huang-sanxing-chen-jian-pei-manzil-zaheer-eea460","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:cbb5d39ef4248f6fc467a079123748a9f84c8b29e813027ed671e9d8dfcd75df","reviewed_at":"2026-10-16T20:11:23.635Z","source_evidence_count":1,"verified_claim_count":2,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":2,"implication_count":2,"watch_condition_count":1,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"CitePretrain shifts citation attribution work from answer-time retrieval into continual pretraining, but its citations are bounded by the documents indexed during training.","observed_facts":[{"text":"The paper introduces CitePretrainBench with Wikipedia, Common Crawl, arXiv, and novel unseen documents, spanning short- and long-form citation tasks.","source_urls":["https://arxiv.org/html/2506.17585v4"]},{"text":"On Qwen-2.5-7B and 3B, Active Indexing improved citation precision over Passive Indexing on every evaluated task, with gains up to 30.2 percentage points.","source_urls":["https://arxiv.org/html/2506.17585v4"]}],"mechanism":"Continual pretraining binds facts to persistent document identifiers; instruction tuning teaches the model to emit identifiers as citations. Active Indexing adds synthetic source-to-fact and fact-to-source examples.","why_now":"The paper tests whether internalized source associations can complement or sometimes substitute for external retrieval when traceability is sought without a retrieval call per answer.","implications":["The first implication is that internal citations may offer a lower-latency fallback when retrieval is unavailable, while remaining limited to the indexed training corpus.","Citation identifiers require a maintained document catalog and validation that the cited source supports the claim."],"evidence_boundary":"The evidence boundary is the authors’ benchmark and experiments on Qwen-2.5-7B and 3B; the reported gains do not establish reliable provenance for arbitrary answers or production use.","watch_conditions":["The first watch condition is whether independent evaluations test citation resolution and attribution errors on models and corpora beyond this benchmark."],"related_records":[],"new_branch_reason":"No prior New Runtime record is supplied; this result begins a distinct analytical record about training-time citation attribution."},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/yukun-huang-sanxing-chen-jian-pei-manzil-zaheer-eea460/","markdown":"https://newruntime.com/posts/yukun-huang-sanxing-chen-jian-pei-manzil-zaheer-eea460.md","json":"https://newruntime.com/posts/yukun-huang-sanxing-chen-jian-pei-manzil-zaheer-eea460.json"},"next_reads":[{"type":"topic","path":"/topics/retrieval/","url":"https://newruntime.com/topics/retrieval/","title":"Retrieval","reason":"Explore the retrieval topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/retrieval.md","json_url":"https://newruntime.com/topics/retrieval.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}