Speculative Decoding in vLLM on AMD GPUs
(news.ycombinator.com)
1.
2.
DSpark: Speculative decoding accelerates LLM inference [pdf]
(news.ycombinator.com)
3.
Eagle 3.1: Collaboration Between the EAGLE Team, vLLM Team, and TorchSpec Team
(news.ycombinator.com)
4.
Accelerating Gemma 4: faster inference with multi-token prediction drafters
(news.ycombinator.com)