FlashMap: Flow Map Speculative Decoding
Speculative decoding accelerates large language model (LLM) inference by using a lightweight drafter to propose a block of tokens that the target model verifies in one parallel pass.
arXiv - cs.CL (NLP)2 min read