{"type":"post","id":"google-research-introduced-a-sleep-framework-letting-llms-7a9ea6","slug":"google-research-introduced-a-sleep-framework-letting-llms-7a9ea6","title":"Google Research introduced a sleep framework letting LLMs consolidate knowledge offline between wake sessions.","description":"Google Research has proposed a “sleep” framework for continual learning in large language models.","retrieval_nugget":"Google Research has proposed a “sleep” framework for continual learning in large language models. It separates active interaction from offline consolidation, using expandable mixture-of-experts memory and self-generated practice to turn temporary context into parameters. For builders, it is a useful design direction, not yet a shipped capability to depend on.","published_at":"2026-10-27","updated_at":"2026-10-27","record_date":"2026-10-27","date_kind":"published_at","topics":["google"],"entities":["Google Research","Sleep Framework","Mixture-of-Experts","Generalized Knowledge Distillation","Ali Behrouz","Vahab Mirrokni"],"related_patterns":[],"novelty_label":"new_fact","what_changed":"Google Research’s sleep framework is a distinct continual-learning approach: it lets LLMs consolidate knowledge offline between wake sessions, unlike the prior self-training framework.","prior_refs":["memory:bb5d17a3-ff10-8b19-a69f-976de228a259","memory:edced072-a452-8cd9-a87f-1e17c6510b5d"],"source_url":"https://research.google/blog/the-sleep-framework-a-new-way-for-llms-to-retain-knowledge-in-continual-learning","source_urls":["https://research.google/blog/the-sleep-framework-a-new-way-for-llms-to-retain-knowledge-in-continual-learning"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:google-research-introduced-a-sleep-framework-letting-llms-7a9ea6","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/google-research-introduced-a-sleep-framework-letting-llms-7a9ea6/","markdown":"https://newruntime.com/posts/google-research-introduced-a-sleep-framework-letting-llms-7a9ea6.md","json":"https://newruntime.com/posts/google-research-introduced-a-sleep-framework-letting-llms-7a9ea6.json"},"next_reads":[{"type":"topic","path":"/topics/google/","url":"https://newruntime.com/topics/google/","title":"Google","reason":"Explore the google topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/google.md","json_url":"https://newruntime.com/topics/google.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}