AnalysisAI ModelsJuly 14, 2026
Four papers advance speculative decoding with tree/block drafters
New arXiv papers propose tree-structured drafters (DominoTree, Trees from Marginals) and block-parallel drafters (DeLS-Spec, progressive tree drafting) to accelerate LLM inference. All methods generate and verify multiple tokens in a single forward pass, targeting higher acceptance rates and lower latency.