NVIDIA inference software cuts token costs 5x on DeepSeek V4 in one month

NVIDIA's inference software stack on Blackwell reduced token costs by up to 5x on DeepSeek V4 in one month. Partners like Baseten, Cognition, and Together AI use TensorRT-LLM and Dynamo to improve throughput and scale workloads.