Taming Outlier Tokens in Diffusion Transformers
Apple ML Research analyzes outlier tokens in Diffusion Transformers (DiTs) for image generation, building on prior Vision Transformer work showing that high-norm tokens attract disproportionate attention while carrying limited local information.
1 source
Apple by email
Get an email when Apple has news
No news that day, no email.
More stories today
- Ethan Mollick: Fable/Astra-class models show initiative, creativity
- MiniMax video model ranks second on Video Arena
- LoopX is a local control plane for agent loop drift
- User shares prompting techniques for TV show characters in Minimax H3
- AirLLM streams layers to run 70B models on limited memory