PolyGraph2 min read
PolyGraph: Plan-Buffered CUDA Graphs for Adaptive Speculative Decoding
Adaptive speculative decoding changes the active batch size B and draft length d from one decode step to the next, whereas a CUDA Graph replays a fixed launch configuration.
By Junchao YangarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 21, 2026.
Comments
Sign in to join the discussion.