{"type":"post","stable_id":"post:continual-adaptation-self-distillation-loop","slug":"continual-adaptation-self-distillation-loop","title":"Macaron And On-Policy Self-Distillation Point Toward Post-Deployment Adaptation Loops","description":"Macaron-V1 frames recursive self-improvement and specialized adapters as a model direction, while on-policy self-distillation supplies a concrete mechanism for learning from student rollouts with extra teacher hints.","retrieval_nugget":"The connection is a proposed controlled loop, not proof that Macaron continuously learns in production. Capture failures, create hints or corrections, train an adapter or student update, run regression and safety evals, then promote or reject a version.","published_at":"2026-08-03","updated_at":"2026-08-06","record_date":"2026-08-03","date_kind":"published_at","topics":["continual-learning","self-distillation","post-training","model-adaptation","evals"],"entities":["Macaron-V1","Applied Compute","OPSD"],"source_urls":["https://alpha.macaron.im/mindlab/research/introducing-macaron-v1","https://www.appliedcompute.com/research/relevance-masked-self-distillation","https://appliedcompute.com/platform/productionizing-self-distillation-methods"],"source_format":"article","editorial_timing":{"lane":"regular_hourly","scheduled_at":"2026-08-08T17:00:00+03:00","real_news_delta":"owner-approved primary-source mechanism or merged analysis"},"visual_decision":{"status":"included","reason":"the central mechanism is a flow, loop, architecture, decision, or state transition that benefits from a diagram","reviewed_by":"codex"},"schema_version":"newruntime-agent-readable-v0.2","status":"published","visuals":[{"role":"hero","src":"/images/drip/continual-adaptation-self-distillation-loop/continual-adaptation-self-distillation-loop.webp","alt":"A whiteboard controlled loop showing deployed-model failures becoming hints, a candidate adapter, regression evaluation, and a versioned promotion gate.","caption":"New Runtime synthesis from Macaron-V1 and productionizing self-distillation methods."}],"routes":{"html":"https://newruntime.com/posts/continual-adaptation-self-distillation-loop/","markdown":"https://newruntime.com/posts/continual-adaptation-self-distillation-loop.md","json":"https://newruntime.com/posts/continual-adaptation-self-distillation-loop.json"}}