NVIDIA unveils NVFP4 for cheaper LLM inference

NVIDIA introduces NVFP4, a new 4-bit floating point format that reduces LLM inference costs while maintaining accuracy. The format is designed for Blackwell GPUs and offers up to 2x throughput improvement.