RayRoPE: Projective Ray Positional Encoding for Multi-View Attention

Apple ML Research proposes RayRoPE, a positional encoding for multi-view transformers that encodes patches uniquely and allows SE(3)-invariant attention. The method can adapt to scene geometry.