AnalysisAI ModelsJuly 17, 2026
xHC expands Transformer residual streams for memory scaling

Hyper-Connections (HC) expand Transformer residual streams into N parallel streams, enabling memory scaling beyond width and depth; gains from N=1 to N=4 are reported. Manifold-Constrained HC (mHC) stabilizes the formulation at scale.