Here’s the story behind why mixture-of-experts has become the default architecture for cutting-edge AI models, and how NVIDIA’s GB200 NVL72 is removing the scaling bottlenecks holding MoE back.

“Bill Gates was bitching about us changing JS all the time,” Eich later recalled of the fall of 1996. Microsoft created its ...