NVIDIA blog details speculative decoding for faster LLM inference

The post, third in a series on AI model co-design, explains how speculative decoding accelerates LLM inference while maintaining accuracy. It covers techniques for co-designing models with inference in mind.