AnalysisDevelopersNovember 3, 2026

NVIDIA lifts Ling-3.0-flash MoE throughput 42.5% on DGX Spark

Read original source →marktechpost.com

Three stacked optimizations — a new MoE kernel backend, an FP8 output layer and speculative decoding — raised GSM8K decode throughput from 37.81 to 53.89 tokens/s on one DGX Spark, with mean latency down 24.5%. Accuracy stayed flat at 96.89% vs 96.82%.

1 source

More stories today

Open the live feed