한국어EN
Inference Infrastructure & ServingGoogle (Leviathan et al.)Google

Speculative Decoding

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Speculative Decoding

Why it matters

Sidesteps the memory-bound nature of decoding without changing the output distribution

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2211.17192

Added in Week 35, 2026 · See that week

On the map — ⑧ Inference Infrastructure line

  1. Previous stopOrca
  2. This record · stopSpeculative Decoding
  3. Next stopvLLM + PagedAttention
See it on the map

Same week

OpenAI releases ChatGPT as a research previewOfficial

Nearby on the same axis

Accelerating LLM Decoding with Speculative SamplingPaperGeorgi Gerganov creates the llama.cpp repositoryOfficialOrcaOfficialAWQPaper