MoE Capacity Factor: Why Mixture-of-Experts Drops Your Tokens

How the MoE capacity factor and router load imbalance silently drop tokens in Mixture-of-Experts models, and how to detect and fix it.

Raccontata dadev.to