The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
GuideGlossaryTokens-per-watt

Tokens-per-watt

Throughput per power under the same controlled conditions and boundary: (tokens/s)/W = tokens/J. “Tokens/W” is shorthand only when model/version, workload, token accounting, precision/quality, context, batch/concurrency, latency, utilization, and measurement boundary are stated.

← All terms