DeepSeek unveils DeepSpark, an open-source speculative decoding system

DeepSpark delivers 50–400% faster inference without retraining or fine-tuning. It attacks the sequential bottleneck of autoregressive generation by using a draft model to propose multiple tokens in parallel.