AnalysisAI ModelsOctober 28, 2026

FlashMap drafter speeds Qwen3-8B decoding up to 6.14x

Read original source →marktechpost.com

Polymathic AI, Princeton, USC ISI, NYU and the Flatiron Institute released FlashMap, a 0.5B flow-map speculative decoding drafter that proposes 16-token blocks in one forward pass. It hits 6.14x lossless speedup on GSM8K at temperature 0, but only 2.28x on Alpaca at temperature 1.

1 source

More stories today

Open the live feed