NVIDIAHow-ToDevelopersOctober 27, 2026

NVIDIA details three MoE inference optimizations for DGX Spark

Read original source →developer.nvidia.com

Profiling Ling-3.0-flash at batch size 1 on DGX Spark showed decoding was memory-bound, so NVIDIA applied Humming MXFP4 MoE kernels, online FP8 quantization of the LM head, and NEXTN multi-token speculative decoding. The model has 124B total parameters with 5.1B active per token.

1 source

More stories today

Open the live feed