Batch Speculative Decoding Done Right
arXiv:2510.22876v2 Announce Type: replace Abstract: Speculative decoding must produce outputs distribution identical to standard autoregressive generation-this output equivalence is not an optimization target but the...