AppleAnalysisAI ModelsAugust 5, 2026

Taming Outlier Tokens in Diffusion Transformers

Apple ML Research analyzes outlier tokens in Diffusion Transformers (DiTs) for image generation, building on prior Vision Transformer work showing that high-norm tokens attract disproportionate attention while carrying limited local information.

1 source

More stories today

Open the live feed