DeepSpark accelerates LLMs 50-400% without retraining

DeepSpark, a speculative decoding method from DeepSeek, speeds up LLM inference by 50-400% without retraining or quality loss. It addresses the autoregressive bottleneck by generating multiple tokens per forward pass.