GPU:CPU ratio
The number of GPUs per CPU in a node; AI servers skew heavily toward GPUs, reshaping system balance.
Current numbers
Benchmark the selected media pipelineper-sample CPU decode cost of image/video vs text — the reason the GPU:CPU ratio must be set per modality
~8:1 → ~2:1 and belowGPU:CPU ratio shifting from training-era norm toward agentic-inference host demand
directional; profile host throughput per workloadagentic-era GPU:CPU ratio, down from the training-era 4:1–8:1 (Intel: 8:1 → 1:1)