VRAM · video RAM
The memory attached to a GPU, used loosely as a synonym for its HBM; it is the ceiling that weights and the KV-cache compete for during inference.
The memory attached to a GPU, used loosely as a synonym for its HBM; it is the ceiling that weights and the KV-cache compete for during inference.