NVIDIAHow-ToDevelopersSeptember 18, 2026

NVIDIA AIPerf benchmarks LLM inference at scale

AIPerf is a ground-up rewrite and designated successor to GenAI-Perf, using a multiprocessed architecture coordinated over ZMQ instead of Perf Analyzer to avoid GIL-bound client bottlenecks. It supports 15+ endpoint types including chat, responses, NIM rankings, and image generation, plus datasets like ShareGPT and trace replays from Mooncake, Baseten, and WEKA.

1 source

More stories today

Open the live feed