The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount

Chapter 0.2

In this chapter · 7 sections
Term help
Terms in this chapter (47)

How to Read This Guide: Decisions, Consequences & Reference Data

Each chapter names one engineering fork, the downstream cost of each branch, and the date-stamped numbers needed to choose. Read the chapter that matches the decision in front of you.

ThreadsPower-boundGoodputDensity ramp

What you'll decide here

  1. Which entry path fits your job: lifecycle stage (siting), discipline (cooling) or workload archetype (an inference fleet). The three lead to different chapters first.
  2. How to read a decision-and-consequence block: name the fork, read the consequence column for your leaning branch, and check reversibility before a number drives it.
  3. Which reference artifact a chapter asks you to produce: design-basis sheet, scalable-unit (SU) budget, decision matrix or scorecard. These, not prose, are the durable output.
  4. How much weight a figure deserves: read its as-of date and caveat first, then check irreversible-fork numbers in the Numbers Register (Appendix D).
  5. Whether a forward-pointer is a bullet, a one-line signpost you can skip, or a real cross-reference to a canonical derivation you should open before deciding.
Place each fork by its cost to reverse: cheap ones are decided on expected value, hard ones are priced first. For a hard-to-reverse fork, check that the future route can carry the upgrade, then compare building now, reserving the route ($60k now, $180k if needed) and waiting for a retrofit with an outage ($420k if needed).

Every chapter here is built around a fork: a point where a real project commits to one branch over another, the branches pull the rest of the facility in incompatible directions, and choosing wrong is expensive or irreversible. The chapter names the fork, lays out the consequence of each branch across the axes that matter (cost, power, reach, latency, reliability, serviceability, schedule), and hands you the date-stamped numbers you need to choose. Most engineering references are organized for the author's convenience: by topic, alphabetically, by the structure of the underlying standard. This one is organized around what you have to decide, and that changes how to read it.

What follows is the user's manual. It covers the decision-and-consequence pattern every chapter follows; the three orthogonal navigation paths (by lifecycle stage, by engineering discipline, by workload archetype) and how to pick yours; the reference artifacts the guide repeatedly asks you to produce (design-basis sheets, SU budgets, decision matrices, scorecards); and, because the field moves fast, how to read the numbers: their vintage, their confidence, and the habit of keeping a stale forecast away from an irreversible decision. It ends with the altitude rule that keeps the guide navigable: a roadmap forward-pointer is a bullet, never a chapter. Leave the chapter with a chosen branch, the test that proves it works, an accountable owner and the input that would reopen it.

The decision-and-consequence pattern

The unit of this guide is the fork and its consequence. A fact tells you that cooling capacity depends on airflow, inlet conditions, heat capture, water availability, climate and equipment limits. A fork tells you that because the cited HPE GB200 profile removes ~115 kW in liquid and leaves ~17 kW to air, committing to that product commits you to its supported direct-to-chip and room-air architecture, facility water if the liquid loop rejects there (an air-assisted sidecar rejects to room air instead), a floor proven for the rack and its delivery route, and a heat-rejection strategy, and that this commitment is a one-way door. Every chapter is written to surface that second kind of statement: name the fork, then the downstream cost of choosing wrong. When you hit one, slow down; that is where the money and the regret concentrate.

The pattern appears in three forms on the page, and reading each quickly is most of what it takes to use the guide efficiently. Decision callouts (the boxed asides) isolate a single high-leverage fork and state the condition under which the evidence favors a branch. They are the chapter's load-bearing claims, so if you read nothing else in a chapter, read these. Decision tables put the branches in rows and the consequences in columns, so you can scan across the branch you are leaning toward and read its full bill of consequences at once. Cross-references (the inline chapter links) mark where a consequence is derived rather than asserted; when a fork hinges on a number you do not trust, follow the link to the chapter that builds it.

How to read each block type in this guide
BlockWhat it carriesHow to read itAction it implies
Thesis + threadsThe chapter's single claim and which of POWER-BOUND / GOODPUT / DENSITY-RAMP it advancesRead first, always; it frames everything belowDecide if this chapter bears on your current fork at all
Decide listThe 3–5 forks this chapter actually resolvesRead second; treat as the chapter's table of contentsMap each bullet to a decision you own
ProseThe derivation — why a fork leads to its consequenceRead closely where the fork is yours; skim elsewhereTrace the causal chain before trusting the conclusion
Decision calloutA single high-leverage fork and the favored branchNever skip; this is the load-bearing claimAdopt, or form an explicit reason to deviate
Decision tableBranches × consequence axesScan across your leaning branch; read its full rowLift directly into your decision matrix
KeynumbersDate-stamped headline figures — sometimes one pinned number, sometimes a dozenRead the as-of and caveat before the valueUse as level only if fresh; else use as direction
Details (deep-dive)Optional engineering depth behind a claimOpen only when the claim is load-bearing for youVerify the derivation; otherwise defer
Cross-reference (xref)Where the canonical derivation livesFollow when you distrust an asserted consequenceOpen the linked chapter before committing
Every chapter is assembled from these blocks. The right reading speed and the action each one implies differ: skim the wrong one and you miss the decision; over-read the wrong one and you drown in reference data.

Three ways in: stage, discipline, archetype

The guide can be entered from three orthogonal directions, and a common mistake is reading it from the wrong one for the question you have. The three indices do not contradict each other. They are three projections of the same material, but they put different chapters in front of you first, and starting from the wrong one wastes time and hides the fork you came to resolve.

By lifecycle stage is the spine and the default. The Parts run in the order a real project runs: strategy and delivery, then siting, power, electrical, cooling, the building, compute, networking, storage, software, security and reliability, commissioning, operations, sustainability, and the future. If you are at a stage, say you have a site and you are sizing the power chain, read the corresponding Part top to bottom; each chapter tees up the decision in the next. This is the right path for project teams executing in order.

By engineering discipline cuts across the spine. If you own cooling, the decisions you live with are scattered across Part 1 (the archetype that sets your density), Part 5 (the thermal engineering itself), Part 13 (commissioning the plant) and Part 14 (operating it). The cross-reference links are the connective tissue: follow them and you assemble a discipline-shaped reading list out of a stage-shaped book. This is the right path for specialists who go deep on one subsystem across every project.

By workload archetype is the path for strategists and anyone scoping a new facility. As Chapter 1.1 argues at length, the workload sets the requirements that density, cooling, fabric, redundancy and siting must meet; the label alone never selects a topology, the measured requirements it implies do. Start from your dominant archetype (pre-training, post-training/RL, online inference, batch inference, edge), read the cascade it implies, and let that cascade tell you which discipline chapters you are now forced to care about. This is the right path when the facility does not exist yet and the question is what to build.

Navigation path → who it is for, where to start, what it optimizes
PathBest forStart atReading orderWhat it optimizes
By lifecycle stageProject teams executing in sequenceThe Part matching your current stageLinear within the Part; follow the spineDecisions teed up in dependency order
By engineering disciplineSubsystem specialists (power, cooling, fabric)Your subsystem's home PartHop the cross-reference links across PartsDepth on one subsystem, every project
By workload archetypeStrategists scoping a new facilityChapter 1.1, then your archetype's chapterCascade outward to the disciplines it forcesGetting the workload decision right first
Three projections of the same material. Pick the one that matches the question you have today; switch projections as the project moves from scoping to execution to operation.

The reference artifacts: what using this guide produces

Using this guide produces a small set of artifacts that the chapters repeatedly ask you to fill in: durable documents that survive board scrutiny and lender diligence because they pin down a decision and its consequences in a form someone else can audit. Four recur throughout, and recognizing which one a chapter is asking for is half of using it well.

  • Design-basis sheet. The frozen assumptions everything downstream inherits: density tier, cooling modality, redundancy topology, voltage architecture, siting class, and the reversible-vs-irreversible register that records which assumptions are hedged and which are committed. Keep one per facility (or per hall). It sets what the workload decision requires of every subsystem. Per-archetype reference sheets are built in Chapter 1.7.
  • Scalable-unit (SU) budget. The repeatable building block you replicate to scale a facility: a defined quantum of compute, power, cooling and fabric (a pod, an NVLink-domain-aligned block) with its power, space, weight, water and cost rolled up. Scoping in SUs rather than raw GPU counts makes a capacity ramp tractable. The SU vocabulary is defined in Chapter 0.3.
  • Decision matrix. The branches-by-consequences table you lift from a chapter's decision tables and adapt to your weights. It turns a fork into a defensible choice on paper: branches in rows, axes (cost, power, reach, latency, reliability, serviceability, schedule) in weighted columns, and the chosen branch and its rejected alternatives recorded.
  • Scorecard. The quantitative roll-up that scores a completed scope: a site-scoring playbook output (Chapter 3.13), an ROI scorecard (Chapter 1.8), an availability/goodput number (Chapter 12.5). Where the matrix chooses a branch, the scorecard grades the whole.

When a chapter hands you a table, ask which artifact it feeds. Most decision tables feed a decision matrix; most keynumbers blocks feed an SU budget or a scorecard; most callouts feed the design-basis sheet's irreversible register. The guide is, in effect, a long set of instructions for assembling these four documents.

Deep dive: how a chapter feeds the four artifacts

Take the density decision from Chapter 1.1 and watch it flow into every artifact. The chapter's decision callout ("training-shaped vs inference-shaped") opens the workload fork, and the design-basis sheet records "training-shaped, liquid-plumbed, power-first siting" only when the equipment and service requirements support that combination. The chapter's cascade table (archetype to requirements) becomes the spine of a decision matrix: copy the row for your archetype, weight the consequence columns by your priorities, and record the rejected alternatives. The chapter's keynumbers (per-rack NVL72 draw, the rack's OEM heat split and TCS/air limits, the interconnection-queue wait) drop into the SU budget. A training SU is then N GB300 NVL72 racks, each provisioned to the peak or busway basis of the OEM configuration you buy (NVIDIA's reference architecture puts a full GB300 NVL72 rack at up to 142 kW, Lenovo rates up to 155 kW peak, and HPE recommends 192 kW busway provisioning), with a separately priced substrate-reserve scenario against the 330 kW per VR200 NVL72 cabinet that NVIDIA's DSX reference design uses to size power and cooling. Add the cooling service and fabric proven to meet your equipment and measured traffic/SLO requirements, and roll it all up to MW and dollars per SU. The chapter's economics pointer to Chapter 1.8 then feeds the scorecard that grades the resulting scope's ROI.

Read this way, a chapter leaves four populated rows across four living documents. If you finish a chapter and none of your artifacts changed, you either did not need that chapter or you read it as a textbook instead of an instrument.

A first screening decision: reserve the route, not the whole future plant

$60kmodeled
Route reservation now
Pays for access and space; it buys no usable kW.
Scope & caveats

Chapter 0.2 worked example only. Buys an empty accessible route, isolation provisions and reserved space; it buys no future cooling capacity. Sensitivity range $40–80k.

$180kmodeled
Upgrade with reserved route
Paid only if the expansion is needed.
Scope & caveats

Chapter 0.2 worked example only. Incremental equipment, installation and allowed outage, reaching the same capacity and service as the unreserved alternative. Sensitivity range $120–240k.

$420kmodeled
Upgrade without a reserved route (retrofit later)
Same service outcome, with retrofit and outage included.
Scope & caveats

Chapter 0.2 worked example only. Incremental equipment, retrofit and lost-service allowance to the same final capacity; assumes the work is still physically feasible. Sensitivity range $300–600k.

Screen: IT load = 4 × 2 × 12 + 4 = 100 kW. Coincident facility demand = 100 + 28 = 128 kW, leaving 160 − 128 = 32 kW of service headroom; heat-removal headroom is 120 − 100 = 20 kW. The fifth rack adds 24 kW: 152 kW fits the electrical service, but 124 kW exceeds heat removal by 4 kW. It fails the screen even though the electrical meter has room. Annual PUE has not entered this peak-capacity test.

Price reversibility: call the displayed reservation cost R, reserved upgrade U and unreserved retrofit F. Expected present cost of reservation = R + 0.50U/(1.10)², about $130k. Waiting costs 0.50F/(1.10)², about $170k. Reserve the route under these assumptions, saving about $40k in expected present cost; do not buy or sell the fifth rack’s cooling capacity yet. The crossover is p = R(1.10)²/(F − U), about 30%. Below that expansion probability, waiting is cheaper; at 20%, reservation costs about $90k against about $70k for waiting. A route that cannot carry the upgrade fails regardless of price.

The four artifacts now have content. The design basis records the 100 kW IT boundary and 128 kW facility demand; the scalable-unit budget counts eight nodes across four racks; the decision matrix selects route reservation over waiting; the scorecard marks the fifth rack’s cooling as failed and physical feasibility as open until a site survey confirms the route. Before anyone buys, the service owner confirms the demand case and the facility engineer surveys the route and its capacity. This is an orientation screen: Chapter 1.7 owns the full basis, Chapter 5.1 the heat boundary and Chapter 1.8 the cash comparison. Epoch’s capital-recovery method supplies the primary time-value reference; the assumed prices are guide inputs.

Numbers provenance and vintage: how to read volatile figures

The figures in this guide span three very different half-lives, and treating them as equally durable is how teams anchor an irreversible decision to a number that was already obsolete when the ink dried. Read every figure through its as-of date and its confidence caveat first, and the value second.

Physics and standards are durable. The thermodynamics of a delta-T across a cold plate and the availability algebra of serial-versus-parallel composition do not move on a quarterly cycle. When a chapter cites them, you can treat them as levels and design against them directly. Rack-cooling selection is an engineering limit, not a universal kW threshold: for your equipment, verify airflow and inlet limits, liquid heat fraction, water-system interfaces, climate, residual room heat, serviceability, redundancy and the future density tail (Chapter 5.1). Hardware specifications are semi-durable. A shipping GB300 NVL72 draws what it draws, and the VR200 NVL72 racks shipping since June 2026 (Dell's first racks went to CoreWeave) are a near-term part you can schedule against: NVIDIA reported racks running at CoreWeave, Google Cloud, Microsoft Azure, OCI and Nebius as Vera Rubin ramped into full production (Q2 FY27 results, 2026-08-26). Confirm your allocation date with the OEM. Rubin Ultra and its ~600 kW Kyber-class rack remain announced, not shipping, and every such figure in this guide is marked as roadmap so you do not budget against a number that may slip a generation. Market and economic figures are volatile. Rental rates, colocation pricing, capex forecasts, depreciation policy and interconnection-queue depth can move by tens of percent within a year. Dell'Oro's outlook for 2030 data-center capex, now more than $3T, nearly doubled between its January and August 2026 forecasts. Read these as direction and order of magnitude, never as a level you can underwrite, and re-check them against a live source before they drive a financial decision.

Every volatile headline figure in the guide is logged, date-stamped and caveated in the Numbers Register (Appendix D), so a critical number is always one click from its source, its vintage and an honest note on how contested it is. Some figures are flagged explicitly as contested, among them GPU economic-versus-book life, hyperscaler depreciation policy and liquid-cooling retrofit capex, because reasonable analysts disagree and the disagreement is itself load-bearing. When a contested figure drives one of your irreversible forks, run the decision across the plausible range rather than a point estimate, and confirm the branch is robust to where the number lands.

132 kW nominal TDP: 115 kW liquid + 17 kW air
NVIDIA GB200 NVL72 by HPE: 132 kW nominal rack TDP, with 115 kW liquid and 17 kW air heat-removal duties
Scope & caveats

Exact HPE product profile. Keep this 132 kW / 115 kW liquid / 17 kW air record separate from the OCP MGX Rev. 1.1 reference profile of 120 kW / approximately 102 kW liquid / 18 kW air.

HPE GB200-specific. GB300 NVL72 differs: Lenovo Press LP2357 (updated 30 August 2026) puts it at ~90% liquid / ~10% air (about 13.5 kW on air at 135 kW rack TDP, ~15.5 kW at the ~155 kW peak), with the NVLink switch trays fully liquid-cooled. Size the residual-air path from the rack you actually buy.

~600 kWforecast
Rubin Ultra Kyber-class rack power: NVIDIA roadmap figure, announced and not shipping
H2 2027 roadmap (GTC 2025); 2028 reported July 2026NVIDIA GTC (Jensen Huang); DCD, Tom's Hardwareregister ↗
Scope & caveats

NVIDIA's published figure (GTC 2025) is 600 kW per Rubin Ultra Kyber rack, and GTC 2026 did not revise it. NVIDIA targets H2 2027. SemiAnalysis reported in July 2026 that Kyber NVL144 slips to 2028 on PCB-midplane manufacturability; NVIDIA says its roadmap is intact but has not published a revised date. SemiAnalysis (26 May 2026) also puts Kyber Ultra at 'approaching 660 kW', a single-analyst estimate noted here but not adopted. On 30 June 2026 SemiAnalysis reported Rubin Ultra with two compute dies rather than the four first expected. NVIDIA has not confirmed that package, and no new rack power follows from it.

2–3 yr bear case vs 4–6 yr estimateforecast
GPU economic life: 2–3-year obsolescence bear case vs published 4–6-year useful-life estimates (contested)
Scope & caveats

The 2–3-year endpoint is a contested stress case rather than an observed universal life.

Contested: analysts disagree on GPU economic life, so run an irreversible decision across the whole range, not a point estimate.

>$3T by 2030forecast
Dell'Oro forecast: 2030 worldwide data-center capex outlook, nearly 2× its January 2026 forecast
Date-stamp every capex figure you plan against; this outlook nearly doubled in seven months.

The altitude rule: roadmaps are bullets, not chapters

A guide this large stays navigable only if it obeys one structural rule, and the rule shapes how you read forward-pointers. A roadmap forward-pointer is a bullet, never a chapter. When a chapter says "this density trend continues toward 1 MW racks," that is a one-line signpost: read it as orientation, do not expect the chapter to derive it, and do not look for a roadmap chapter that does not exist. The per-part roadmaps, the consolidated 2026 to 2030 subsystem trajectories, live in exactly one place, Chapter 16.2, so the forward-looking material does not spread across forty chapters and rot independently in each. Every other chapter points forward with a bullet and sideways to its canonical derivation with a cross-reference.

The same single-source discipline governs the whole guide: a concept is defined once, in its canonical home, and referenced everywhere else. The facility metric stack is defined in Chapter 15.1 and the useful-work metrics in Chapter 14.1, both merely oriented in Chapter 0.3; the redundancy vocabulary is primed in Chapter 0.5 and engineered in Chapter 12.1; the standards landscape is indexed in Chapter 0.4. When you hit a term defined elsewhere, the cross-reference tells you this chapter is consuming a definition it does not own, and that if you distrust the definition you should follow the link rather than re-derive it locally. Read the cross-references as the dependency graph of the guide, and you will always know where the authoritative version of any claim lives.

Deep dive: the three narrative threads and how to read for them

Three threads run the length of the guide, and most chapters advance one or two. Reading for the thread that matches your pressure is a fast way to find the chapters that bear on your situation. POWER-BOUND is the recognition that the binding constraint moved from chips to megawatts: the question is no longer how many accelerators you can buy but how many MW you can energize, and when. The chapters carrying this thread decide time-to-power, interconnection queues and behind-the-meter generation; read them when your gate is the grid. GOODPUT is the insight that AI factories optimize useful work delivered within the declared quality and service limits, not raw uptime; as a time fraction, it is the share of wall-clock time that advances the job. It is not MFU, and it does not by itself choose N, N+1, 2N or a Tier topology. The redundancy worth buying is the kind whose outage states cost more goodput than they cost to prevent. For checkpointed training, the next redundancy dollar usually buys more goodput in the cluster than in facility nines; for SLA-bound inference it does not (Chapter 12.2 prices the trade). Read this thread when you are tempted to over-build nines. DENSITY-RAMP is the warning that designing to today's density and being surprised by the ramp is the era's signature irreversible mistake. The fix is to make the substrate (floor, power, water, plumbing) accommodate the ramp while keeping the IT fit-out matched to the current generation.

The threads are not chapters, and you cannot read them in isolation; they are lenses. Each chapter's threads field tells you which lenses it sharpens. If your project is gated on power, follow POWER-BOUND; if you are arguing about redundancy, follow GOODPUT; if you are scoping a multi-generation facility, follow DENSITY-RAMP. The same chapter often reads differently through each lens, which is the point.

Reading the guide well: a short protocol

Put the pieces together into a protocol you can run on any chapter. One: read the thesis and the decide list, and ask whether the chapter bears on a fork you own. If not, move on; the guide is not meant to be read whole. Two: for each fork it does raise, classify it on the reversibility axis before you let any number drive it. Three: read the decision callouts as the chapter's central claims, and scan the decision tables across the branch you are leaning toward. Four: before lifting any figure into an artifact, check its as-of date and caveat, and test volatile market numbers as dated ranges. Five: when a consequence is asserted rather than derived and the fork is yours, follow the cross-reference to the canonical chapter. Six: capture the outcome in the right artifact (design-basis sheet, SU budget, decision matrix or scorecard), because the artifact, with its owner, acceptance test and reopening trigger, is the durable output. Run that loop and the guide does what it is for: it turns a fast-moving, power-bound, multi-disciplinary build into a sequence of well-posed, well-dated decisions.

This chapter's framework is exercised immediately in Chapter 1.1, where the workload archetype is established as the master variable and the reversibility lens is applied in full. The vocabulary and metric stack you need to parse every figure are oriented in Chapter 0.3 (useful-output accounting in Chapter 14.1, efficiency definitions in Chapter 15.1, cost denominator in Chapter 1.8). The standards every decision is graded against are indexed in Chapter 0.4. The redundancy and availability primer that the GOODPUT thread builds on is in Chapter 0.5, engineered in Chapter 12.1 and reframed as goodput versus availability in Chapter 12.2. The reference artifacts live with their decisions: design-basis sheets and SU budgets in Chapter 1.7, the site scorecard in Chapter 3.13, the ROI scorecard in Chapter 1.8. All consolidated forward-looking roadmaps live in one place, Chapter 16.2, as the altitude rule requires.
Cite this chapter
Fehn, J. (2026). How to Read This Guide: Decisions, Consequences & Reference Data (Chapter 0.2). The Definitive Guide to AI Data Centers. https://aidatacenterguide.com/part-0-foundations-and-how-to-use-this-guide/0-2-how-to-read-this-guide-decisions-consequences-and-reference-data (accessed 2026-10-25).
@misc{aidc-0-2,
  author       = {Fehn, Jacob},
  title        = {How to Read This Guide: Decisions, Consequences & Reference Data (Chapter 0.2)},
  howpublished = {The Definitive Guide to AI Data Centers},
  year         = {2026},
  url          = {https://aidatacenterguide.com/part-0-foundations-and-how-to-use-this-guide/0-2-how-to-read-this-guide-decisions-consequences-and-reference-data},
  note         = {Accessed 2026-10-25}
}
Spotted an error? Suggest an edit