NVIDIA's Chris Alexiuk discusses model compression at the edge

The talk explores findings from the 'super weights' paper, noting that GLM 5.2 can be compressed from 1.5 terabytes to 250 GB—an 86% reduction—without proportional performance loss. It highlights that model layers are unequal, with the first and last layers carrying significant weight.

Featured · Chris Alexiuk