The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › Expert parallelism

Expert parallelism · EP

Distributing a Mixture-of-Experts model's experts across GPUs, routing tokens to whichever GPU holds the chosen expert.

Also written as: wide EP

Related terms: GPU

Where the guide uses this

1.2
Training Data Centers: Synchronous, Dense, Checkpointable
8.2
Scale-Up Fabric (Intra-Node / Intra-Rack)
1.1
The Archetype Decision Framework: Workload Is the Master Variable
E
Glossary, Phase-Gate Timeline & Learning/Community Map
1.7
The Requirements-and-Consequences Matrix
7.3
AMD Instinct & the Open Challenger

← All terms