{"type":"raw_signal","id":"what-is-speculative-decoding-70-minute-read-5f6242","slug":"what-is-speculative-decoding-70-minute-read-5f6242","title":"What is Speculative Decoding? (70 minute read)","description":"AstraBlog published a long technical explainer by Aleksandr Samarin on speculative decoding, framing it as a response to memory-bound autoregressive generation.","retrieval_nugget":"AstraBlog published a long technical explainer by Aleksandr Samarin on speculative decoding, framing it as a response to memory-bound autoregressive generation.","observed_at":"2026-10-12","record_date":"2026-10-12","date_kind":"observed_at","why_it_matters":"AstraBlog published a long technical explainer by Aleksandr Samarin on speculative decoding, framing it as a response to memory-bound autoregressive generation. It explains how a drafter proposes multiple tokens for a target model to verify in one pass, and how acceptance rules preserve the target distribution during sampling. The article also surveys attached drafters including EAGLE-3, multi-tok","novelty":"notable","verification_level":"source-linked","signal_type":"research","source_platform":"astralord.github.io","topics":[],"entities":["AstraBlog","Aleksandr Samarin","EAGLE-3","DFlash","DSpark"],"related_patterns":[],"source_url":"https://astralord.github.io/posts/speculative-decoding-the-art-of-guessing-well","source_urls":["https://astralord.github.io/posts/speculative-decoding-the-art-of-guessing-well"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"signal:what-is-speculative-decoding-70-minute-read-5f6242","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/signals/what-is-speculative-decoding-70-minute-read-5f6242/","markdown":"https://newruntime.com/signals/what-is-speculative-decoding-70-minute-read-5f6242.md","json":"https://newruntime.com/signals/what-is-speculative-decoding-70-minute-read-5f6242.json"},"next_reads":[{"type":"collection","path":"/signals/","url":"https://newruntime.com/signals/","title":"Raw Signals","reason":"Open every source-linked raw signal.","media_type":"text/html","json_url":"https://newruntime.com/signals.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}