AnalysisAI ModelsOctober 13, 2026

λ-JEPA spectral regularizer targets backbone collapse in JEPA

Read original source →arxiv.org

SACReg, a spectral anti-collapse regularizer motivated by λ-balance analysis, is applied to JEPA as λ-JEPA, improving over LeJEPA and VISReg on ImageNet-1k classification and average linear-probe transfer across eight downstream image datasets. On video SSL it beats LeVJEPA and V-JEPA 2 on Something-Something-v2 and Kinetics-400.

2 sources

More stories today

Open the live feed