NVIDIAAnalysisDevelopersSeptember 10, 2026

NVIDIA NIM optimizations deliver 2.5x more users on Nemotron 3 Ultra

NVIDIA benchmarked NIM against an open-source baseline on 4xB200 GPUs with a 64K/400/76% KV-reuse agentic workload at 50 TPS per user (20 ms ITL), reporting up to 2.5x higher throughput. NIM Certified adds inference-stack updates, CVE handling, and commercial support via NVIDIA AI Enterprise.

1 source

More stories today

Open the live feed