The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › Memory-bandwidth-bound

Memory-bandwidth-bound

A workload limited by how fast data moves from memory rather than by compute; typical of inference decode.

Related terms: Decode · SM

Where the guide uses this

7.10
Precision, Quantization & the Compute-Memory Tradeoff
10.11
Inference Serving Engineering: SLOs, Batching, Disaggregation & Goodput-Optimal Scheduling
8.2
Scale-Up Fabric (Intra-Node / Intra-Rack)
16.3
Software, Orchestration & Efficiency at the Frontier
1.4
Post-Training, Fine-Tuning & RL: The Hybrid Middle
1.3
Inference Data Centers: Bursty, Distributed, Always-On

← All terms