New bounds for transient amplification in coupled gradient descent

Arxiv CS.LG (machine learning)

Paper introduces pseudospectral bounds to analyze transient amplification in coupled gradient descent, common in bilevel optimization and adversarial training. The theoretical work provides non-asymptotic analysis of block-triangular Jacobian systems.

Arxiv CS.LG (machine learning)·Ahanaf Hasan Ariq

7 days ago