LaunchDevelopers
Jun 28, 2:18 PM
DeepSeek releases DeepSpec codebase for speculative decoding draft models
DeepSpec is a full-stack toolkit including data preparation, draft model implementations, training code, and evaluation scripts. It aims to accelerate inference by training lightweight draft models for use in speculative decoding.