Community debates value of MoE versus dense models

A Reddit post questions why Mixture-of-Expert models are often dismissed compared to dense models despite their widespread use. Commenters discuss trade-offs between total and active parameters.