Prefill
The compute-heavy phase that processes an inference prompt and builds its KV cache before generation begins.
Current numbers
xPyDruntime-reconfigurable disaggregation: x prefill workers feeding y decode workers, re-balanced live
The compute-heavy phase that processes an inference prompt and builds its KV cache before generation begins.