AnalysisAI ModelsOctober 15, 2026

Three papers probe looped Mixture-of-Experts scaling recipes

Read original source →arxiv.org

Three arXiv preprints examine looping shared Transformer blocks in sparse MoE LLMs under FLOPs-matched comparisons. One argues looping benefits for large MoE models remain unclear; another proposes flattening experts and untying attention; a third, LatentLoop, allocates compute asymmetrically across loop visits.

How this story unfolded

10 days · 3 reports · from Oct 5

  1. Oct 5
  2. Oct 6
  3. Oct 15

More stories today

Open the live feed