Field noteOct 22, 20261 min read1 source

JOLT extends OPSD , or On-Policy Self-Distillation.

In one minute

Siyan Zhao, Zhihui Xie, Mengchen Liu, Jing Huang, Guan Pang, Feiyu Chen, and Aditya Grover describe On-Policy Self-Distillation (OPSD) in the arXiv paper “Self-Distilled Reasoner.” The first version was submitted on January 26, 2026; arXiv lists a third revision dated March 20, 2026.

What changed: Introduces OPSD, where one LLM uses privileged reasoning traces to supervise its own on-policy rollouts, reporting improved benchmark performance and token efficiency.

OPSD uses a single LLM's shared weights for both teacher and student roles. The student sees only the question, while the teacher is conditioned on privileged information such as verified reasoning traces. Training minimizes per-token divergence between the two policies on rollouts sampled by the student.

The authors report results on multiple mathematical-reasoning benchmarks, claiming better token efficiency than the reinforcement-learning methods they compare against and better performance than off-policy distillation. The arXiv record says code has been released.

The paper does not establish that the method generalizes beyond its evaluated reasoning tasks, nor does it provide evidence here for production deployment benefits or comparisons to every alternative training method.

Evidence / sources

  1. 1arxiv.org/abs/2601.18734
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicModelsExplore the models topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract