Adam breaks rotational invariance of factored-model loss

In factored models W = UV^T, the loss is invariant to rotations (U,V)→(UQ,VQ); gradient descent respects that, but Adam's per-coordinate second moment depends on the basis and does not.