NVIDIAHow-ToDevelopersNovember 13, 2026

NVIDIA shows serving GLM-5.3 across two DGX Stations with vLLM

Read original source →developer.nvidia.com

GLM-5.3 NVFP4 packs 753B parameters (40B active per token) into a ~464 GB checkpoint, exceeding the 252 GB HBM3e on a single GB300 GPU. Tensor parallelism (TP=2) over ConnectX-8 RDMA splits weights across two Stations behind one OpenAI-compatible endpoint.

1 source

More stories today

Open the live feed