AnalysisAI ModelsNovember 6, 2026

SAE study finds MoE experts specialize in interpretable features

Read original source →arxiv.org

A sparse autoencoder trained on mixture-of-experts layer outputs shows individual experts drive specific latent features, with specialization finer-grained than routing or domain labels suggest. Experiments used Qwen3-30B-A3B.

1 source

More stories today

Open the live feed