CPU · Central Processing Unit
The host processor in a GPU node: runs the OS, storage and data pipelines, and orchestration while the accelerators do the tensor math; the CPU:GPU ratio is a node-design choice.
Current numbers
Benchmark the selected media pipelineper-sample CPU decode cost of image/video vs text — the reason the GPU:CPU ratio must be set per modality
~8:1 → ~2:1 and belowGPU:CPU norm rebalancing toward more CPU per node as agentic RL adds rollout/tool/env load
~8:1 → ~2:1 and belowGPU:CPU ratio shifting from training-era norm toward agentic-inference host demand