Chapter 11.1
In this chapter · 6 sections
Terms in this chapter (50)
- SL1–SL5
- Egress
- DDR5 (double data rate 5 (SDRAM))
- TEE (Trusted Execution Environment)
- CPU (Central Processing Unit)
- GPU (Graphics Processing Unit)
- Confidential computing
- Archetype
- Two-person rule
- Capex (Capital Expenditure)
- NIST (National Institute of Standards and Technology)
- SOC 2
- GB200
- NVL72
- GB300
- Rubin
- Hyperscaler
- Blast radius (Fault domain)
- BMC (Baseboard Management Controller)
- IPMI (Intelligent Platform Management Interface)
- EPMS (Electrical Power Monitoring System)
- BMS (Building Management System)
- Root of trust (RoT)
- PII (Personally Identifiable Information)
- Goodput
- SLA (Service Level Agreement)
- OT (Operational Technology)
- MFA (Multi-Factor Authentication)
- Air-gap
- NIST SP 800-53
- Rollout
- HBOM (Hardware Bill of Materials)
- SBOM (Software Bill of Materials)
- OCP (Open Compute Project)
- Caliptra
- DICE (Device Identifier Composition Engine)
- DC-SCM (Datacenter Secure Control Module)
- Measured boot (Attestation)
- HBM (High-Bandwidth Memory)
- NVLink
- MIG (Multi-Instance GPU)
- Zero trust
- DPU (Data Processing Unit)
- CDU (Coolant Distribution Unit)
- BESS (Battery Energy Storage System)
- Powered shell
- Neocloud
- Floor loading
- ISO 27001
- 2N
Threat Model, Assets & Security Levels for AI Infrastructure
Frontier weights, concentrated accelerator inventory and plant controls are different valuable assets. Name which adversary can steal, disable or manipulate each before you select controls.
ThreadsPower-boundGoodputDensity ramp
What you'll decide here
- Which RAND level (SL1–SL5) to build to, or which asset (prompts, integrity, credentials, availability) sets the target when weight theft is not the top risk.
- Which assets are crown jewels (frontier weights, allocation-locked silicon, the management plane) and which are merely valuable; over-defending the wrong one strands capital.
- Which adversary tier to defend against. RAND rates eight of 38 vectors likely infeasible for OC1–OC3 but likely feasible for OC4 or OC5.
- Price isolation, attestation and egress controls against your adversary, and against the latency, throughput and operating access each one costs.
- Set standoff, network trust zones and root-of-trust and attestation interfaces before construction or hardware purchase makes them expensive to change.
Every control in an AI data center follows from a question almost nobody states: which adversary are you trying to stop? Not "hackers" in the abstract, but a specific tier, from a bored insider with a USB stick to a top-priority operation run by the most cyber-capable state on earth. That answer drives Part 11 the way the workload archetype drove Part 1. Pick it and the firewall rules, the standoff distance, the attestation flow, the egress cap and the two-person rule all follow. Skip it and you buy expensive controls that defend the wrong asset against the wrong attacker, and you find the gap the day a competitor’s frontier weights show up on someone else’s cluster.
The chapter builds the threat model in three moves. First, why AI data centers are a special case: asset-value density, IP concentration and strategic targeting together make an unscoped cloud-security posture inadequate for some services. Second, the asset taxonomy and adversary tiers, anchored on the RAND Securing AI Model Weights framework: five Weights Security Levels, five operational-capacity adversary tiers, and the 38 attack vectors that map between them. Third, the defense-in-depth reference architecture and the method of setting a target level and deriving controls from it. Each control you select must name the attack path it constrains, the proof that it is enforced, and its cost in capex, performance or operability. The target level and service boundary frame that trade before you commit steel, silicon or staff. For the platform side, NIST’s draft SP 800-239 (initial public draft, July 2026; comments closed 25 September 2026) analyzes threats and security gaps across AI data-center architecture, hardware, software, workflows and storage. Treat it as a gap checklist alongside RAND, and remember it is still a draft.
Why an AI data center is a special case
A hyperscale e-commerce hall and a frontier-training campus can look the same from the road and run the same SOC 2 controls, yet sit in completely different threat models. Three properties make the AI facility a special case, and each one breaks an assumption that generic data-center security relies on.
Asset-value density. A single GB200 NVL72 rack is about $3.1M for the server alone in SemiAnalysis’s August 2025 hyperscaler model. Its accelerator supply and replacement lead time add a separate exposure, and its GB300 and Vera Rubin successors (the latter shipping since June 2026) come out of the same constrained allocation. The constraint, not the dollar figure, changes the economics. Generic cloud hardware is fungible and insured. A stolen or destroyed NVL72 is not replaced by a purchase order but by waiting at the back of an allocation queue measured in quarters. That inverts the loss function: the asset is worth more because it cannot be re-bought quickly, which makes physical theft and physical destruction rational adversary goals in a way they never were for commodity servers. The March 2026 drone strikes (below) show that the destruction case is no longer hypothetical.
IP concentration. The frontier model weights on the cluster are arguably the highest-value digital asset in existence: a multi-hundred-million-dollar training run compressed into a few terabytes that, once exfiltrated, hand a competitor or an adversary state a capability they did not pay to build. RAND treats frontier weights as a national-security asset warranting defenses up to nation-state grade. The loss is silent and complete. Unlike a stolen database, a copied weight file leaves the original in place, so there is no outage, no missing inventory and no obvious tell; the first signal may be a rival model that is suspiciously similar. So egress control, not perimeter control, becomes the linchpin (→ Chapter 11.8).
Strategic targeting. States now treat AI compute as strategic infrastructure, so the adversary set includes actors with intelligence services, kinetic reach and supply-chain access, not just criminals. On 1 March 2026, during the US–Israel–Iran war, drones directly struck two AWS facilities in the UAE and damaged a third in Bahrain with a nearby strike. AWS reported structural damage, power loss and fire-suppression water damage, and two of the three UAE availability zones went down at once, so multi-AZ redundancy failed (AWS Health Dashboard; CNBC; The Conversation, March 2026). IRGC-linked media claimed the sites were targeted deliberately for supporting US military and intelligence work; Amazon has not confirmed a motive. Industry analysts called it likely the first publicly confirmed military attack on a US hyperscaler’s data centers. The outage did not end there. In September 2026 a status update from AWS said it could not restore customers’ access to resources and data that existed only in mec1-az2, one of the UAE zones. Nor could AWS restore its Bahrain region, offline since April, when a second zone there was disrupted (Reuters, 16 September 2026). Losing availability is loud, yet the loss is recoverable only where copies and spare capacity sit outside the blast radius: another region, not just another zone. The planning consequence is blunt: "kinetic attack on a data center" moved from a tail risk you accept to a design case you must address, and most legacy physical controls (fences, cameras, ground access control) were never designed for an aerial threat (→ Chapter 11.2).
Asset taxonomy: what you are actually protecting
You cannot derive controls from a target level until you know which assets the level protects, and the most common scoping error is treating every asset as equally precious. An AI data center has a clear hierarchy of crown jewels. The heaviest controls belong on the top tier, with lighter controls deliberately accepted below it, because a budget spread evenly defends nothing well. Five asset classes follow, ranked by what an adversary actually wants and what its loss costs.
| Asset class | Why it is valued | Primary adversary goal | Loss signature | Dominant control (→ chapter) |
|---|---|---|---|---|
| Model weights & training IP | Highest-value digital asset; multi-$100M run compressed to TB-scale | Silent exfiltration (theft, not destruction) | None — original stays in place; first tell is a rival model | Egress caps + attestation-gated key release (→ 11.8, 11.5) |
| Accelerator silicon | GB200 server only: about $3.1M in the August 2025 hyperscaler model; replacement allocation is a separate constraint | Theft for resale/diversion, or destruction to deny capability | Missing/damaged inventory; outage | Physical zones, standoff, counter-UAS (→ 11.2) |
| The management & control plane | BMC/IPMI, EPMS/BMS, schedulers, key brokers — keys to everything | Privileged foothold; lateral movement; sabotage | Often none until used; anomalous control actions | Management-plane isolation + root of trust (→ 11.4, 11.7) |
| Customer & training data | Regulated PII, proprietary corpora, contractual confidentiality | Exfiltration; privacy/compliance breach | Sometimes none; surfaces in audit or breach | Tenant isolation + data governance (→ 11.6, 10.10) |
| Facility availability itself | Goodput and SLA revenue; war-infrastructure status | Disruption, ransom, or kinetic denial | Outage — the one loud, obvious signature | Physical resilience + OT hardening (→ 11.2, 11.10) |
Read the table top-down as a budgeting instrument. Unreleased frontier weights sit at the top of this confidentiality example because a copied artifact can leave the owner unaware and cannot be recalled. They justify confidential computing, attestation and hard egress caps where the adversary and exposure justify the cost. Facility availability sits at the bottom of the confidentiality hierarchy not because outages are cheap but because they are loud: you may detect the loss promptly, though failover needs tested capacity and an eligible recovery path, whereas a copied weight file is the loss you never see. The management plane is the sleeper. It is rarely the adversary’s objective, but it can be a path, which is why it gets crown-jewel-grade controls despite holding no IP of its own. For an open-weight service, tenant prompts, credentials and availability can rank above the already-public weights. Misranking these is how budgets get spent on hardening the loud asset, whose recovery depends on copies held outside the region, while the silent, unrecoverable one walks out an unmonitored egress.
Adversary tiers: the RAND operational-capacity ladder
The RAND Securing AI Model Weights report (RRA2849-1) is the field’s shared vocabulary. Its central insight is that you cannot reason about "is this secure" without naming the adversary. RAND defines five operational-capacity (OC) tiers of attacker, from OC1 (amateurs) to OC5 (the top cyber-capable states running their highest-priority operations), and enumerates 38 distinct attack vectors across them, from social engineering and supply-chain implants to side-channels and human intelligence. The decisive finding for design: RAND assesses eight vectors as likely infeasible for OC1–OC3 and likely feasible for OC4 or OC5, so the required control set steps up along the continuum of attacker capability.
Mapped onto those adversaries are five Weights Security Levels (SL1–SL5), each defined operationally: an SL is the posture assessed as likely to thwart the matching OC tier’s attempt to steal the weights. SL1 thwarts amateurs. SL2 thwarts professional opportunistic attackers running moderate-effort, non-targeted operations. SL3 thwarts cybercrime syndicates and capable insiders. SL4 thwarts the standard operations of leading cyber-capable institutions. SL5 could plausibly claim to thwart the top-priority operations of the most capable states (RAND, 2024). The framework replaces "we’re secure" with a question: secure against which adversary? It also gives a campus a target number to design toward. RAND did not mean the 2024 levels as a standard: it calls the benchmark measures it lists for each level neither a complete standard nor a compliance regime. Its first standardized control set is the August 2026 SL3 framework (below), which stops at SL3, so a claim of SL4 or SL5 still rests on an assessor’s judgment against the 2024 benchmarks.
| Level | Thwarts (RAND OC tier) | Defining new capability | Dominant cost added at this level |
|---|---|---|---|
| SL1 | Amateur attempts (OC1) | Basic hygiene: patching, MFA, access logging | Negligible — table stakes |
| SL2 | Professional, non-targeted attackers (OC2) | Hardened perimeter, encrypted storage, vuln mgmt | Modest — standard enterprise security |
| SL3 | Cybercrime syndicates & capable insiders (OC3) | Insider-threat program, segmentation, multiparty authorization on weight access, centralized weight storage, guarded halls swept for unauthorized devices, supply-chain controls | Real — isolation taxes goodput; insider program is org-wide |
| SL4 | Leading cyber-capable institutions (OC4) | Confidential computing for weights in use, hardware root of trust, attestation-gated keys, hardware-enforced output limits (hard egress), isolated weight storage, air-gap-adjacent design, hardware-validated supply chain | High — performance overhead, operational drag, supply-chain vetting |
| SL5 | Top-priority nation-state operations (OC5) | Near-air-gap, exhaustive supply-chain provenance, two-person everything, side-channel mitigation | Severe: usability, throughput and cost all suffer. RAND (2024) calls SL5 currently not possible |
Scope & caveats
RAND 2024 expert assessment under its defined adversary capabilities, not a categorical impossibility statement. RAND's main text counts eight (printed p.18); its Table 5.2 scores nine vectors this way, and its summary says about a dozen are infeasible for non-state actors.
The defense-in-depth reference architecture
Defense in depth in an AI data center is a stack of independent boundaries, each owned by a different chapter of Part 11, arranged so that defeating one layer does not defeat the asset. Read it from the outside in. That is the order an outside attacker must traverse, and the order in which a missing layer turns a partial compromise into a total one.
- Physical perimeter and zones — siting standoff and the concentric zones (perimeter → facility → data hall → cage/rack, deepened into a five-zone reference model) with escalating MFA, surveillance and, now, counter-UAS for the aerial threat the March 2026 strikes made real (→ Chapter 11.2).
- Supply-chain and provenance — vetting silicon and firmware before it enters the fence, tamper-evident logistics, HBOM/SBOM and OCP S.A.F.E. firmware audits, because a counterfeit part or implant defeats every layer above it from inside (→ Chapter 11.3).
- Hardware root of trust and firmware — a silicon RoT (Caliptra, DICE identity on DC-SCM), secure and measured boot, and a hardened, segmented BMC, so the foundation every higher control trusts is itself attestable and not the soft underbelly (→ Chapter 11.4).
- Confidential computing and tenant isolation — a GPU TEE that fences a compute-protected region of HBM behind hardware firewalls (NVIDIA does not encrypt HBM; on-package memory is simply hard to reach), traffic to and from the GPU encrypted through bounce buffers, NVLink encrypted on Blackwell between the GPUs of one confidential VM, and attestation, plus the MIG/vGPU isolation boundary whose documented limits set how far you can trust a shared GPU (→ Chapter 11.5, Chapter 11.6).
- Network segmentation and zero trust — DPU-enforced microsegmentation, management-plane isolation, and egress control as the anti-exfiltration choke point (→ Chapter 11.7).
- Model and weight protection — the crown-jewel layer: at-rest encryption, in-transit protection, attestation-gated in-use keys, and the egress caps that catch the silent loss (→ Chapter 11.8).
- The human layer and OT plane — insider-threat controls, two-person rules, and hardening of the facility’s OT/ICS (BMS/EPMS/CDU/BESS) against cyber-physical sabotage, the layers that no amount of cryptography can substitute for (→ Chapter 11.9, Chapter 11.10).
The layers are arranged for independence. A compromised BMC should not yield the weights if confidential computing and egress caps still stand, and a defeated fence should not yield the silicon if the data hall and cage zones still gate access. Defense in depth fails not when one layer is breached, which is expected, but when layers share a single point of failure (a flat management network, a universal admin credential, an unmonitored egress) that lets one breach cascade.
Setting a target level and deriving controls
| Service | Protected asset / adversary | Operator boundary | Admission evidence / decision |
|---|---|---|---|
| Frontier training | Unreleased weights; adversary selected by model owner | Training platform, privileged people and model movement; landlord supplies facility controls | Owner-approved threat assessment and tested weight lifecycle; reject a state-actor protection claim based only on SL3 controls |
| Proprietary inference — worked case S11 | Private model and customer inputs; hostile co-tenant and ordinary platform administrator | Model owner controls release policy; GPU operator controls platform; landlord controls facility | CVM evidence plus workload-bound key release; initially reject because recipient-key binding test fails |
| Open-weight shared inference | Customer inputs, credentials and correct service; hostile tenants | Service runtime and tenant boundary; public weights need no theft-prevention budget | Isolation, input retention and API authorization tests; admit only sharing modes that pass them |
| Powered shell / colo | People, tenant equipment and contracted facility availability | Landlord owns physical and OT controls; tenant owns application and keys | Signed responsibility schedule, physical ATP and OT register; no landlord attestation of an unseen tenant application |
The method inverts how security is usually bought. Instead of starting from a catalog of controls and asking which to adopt, start from the target Weights Security Level, the adversary tier you have decided the campus must survive, and derive the controls necessary to reach it. The level is the design basis and the controls are its consequences. It is the same shape as the workload archetype driving the whole facility in Part 1: one upstream decision that collapses a hundred downstream ones.
The target level is a business decision, not a security one. A neocloud renting commodity inference capacity to many tenants may rationally target SL2–SL3: its assets are valuable but are not frontier weights, and the cost of SL4 controls (performance overhead, operational drag, supply-chain vetting) would price it out of a margin-thin market. A frontier lab training a flagship model has no such luxury. Its adversary is OC4–OC5 by definition, so anything below SL4 is a posture mismatched to its actual threat, and the over-investment is the only rational investment. The error is choosing a level by budget and hoping the adversary cooperates. The adversary is set by what you hold, not by what you can afford.
Two consequences make the level a substrate decision, not a policy one. First, the irreversible layers must be built to the highest level the campus might ever host, because you cannot retrofit standoff distance, network trust zones or a hardware root of trust (→ Chapter 11.4) into a running cluster without tearing it down. The same density-ramp logic governs floor loading and water (the ramp framing in Chapter 1.1; structure in Chapter 6.2). Second, every level above SL2 taxes goodput and operability: isolation strands capacity, attestation adds latency, egress caps constrain legitimate data movement, and two-person rules slow operations. The target level prices that tax up front, which is why it must be decided before the controls are bought. The trade is then made with eyes open, not discovered control by control after the cluster is live.
Deep dive: why eight attack vectors make nation-state defense a different problem
The instinct is to treat security as a continuum: more budget, more controls, more protection, so that defending against a nation-state is just defending against a criminal with the dial turned up. RAND’s vector analysis shows that the required controls do not scale uniformly along that continuum. Of the 38 enumerated attack vectors, RAND assesses eight as likely infeasible for OC1–OC3 adversaries and likely feasible for OC4 or OC5. The vectors RAND scores this way are mostly physical and human: planting a candidate in the organization, or using organizational leverage over its people; evading physical access control, penetrating hardware security or armed break-in (and, at OC5 only, military takeover); side-channel and TEMPEST attacks; extracting the model; and backdoors built into the access-control system itself. RAND scores supply-chain compromise and the bribing or blackmailing of insiders as already likely feasible for OC3, which covers cybercrime groups and insiders, so an SL3 program has to handle them, not only an SL4 one.
The consequence is a practical step-up in controls along a capability continuum. Reaching SL3 is largely about doing enterprise security exceptionally well: hygiene, segmentation, insider controls, supply-chain security, centralized weight storage and guarded halls. Reaching SL4 and SL5 means defending against vectors that require a different control set. Armed and covert physical access is in play, so you need physical guarding and device bans. Software and a privileged insider can no longer be trusted, so security-critical assumptions move into hardware: confidential computing and hardware output-rate limits. The network is assumed to be under patient surveillance, so weight storage is isolated. This step-up is why the SL2-to-SL4 jump dominates the cost of any serious AI-DC security program, and why a campus that wants to host frontier training cannot drift into the right posture. It has to be designed for the step-up from the start. → adversary-specific controls thread through Chapter 11.3 (supply chain), Chapter 11.4 (root of trust) and Chapter 11.9 (insiders).
Deep dive: the security-vs-goodput frontier, made explicit
Part 12 frames AI-cluster reliability as goodput, useful work delivered, rather than raw availability. Security sits on the same axis. Each control in Part 11 changes exposure, and can add cost or recover losses that attacks would otherwise cause. Confidential computing adds encryption and attestation overhead to every protected transfer (the Blackwell generation narrows but does not eliminate it). MIG and single-tenancy can strand capacity that a tested time-slicing deployment would have packed (→ Chapter 11.6). Hard egress caps constrain legitimate large-scale data movement, not just exfiltration. Two-person rules and privileged-access workflows slow every operation a single admin used to do alone. Microsegmentation adds policy and operational work, and its throughput cost depends on the enforcement path.
None of these are arguments against the controls. They are the price of the controls, and the target level decides whether the price is worth paying. An SL2 target still needs proof that the controls you chose cover its adversary paths. At SL5 you pay heavily across throughput, usability and cost because you are defending against an adversary who will spend years and a state’s resources to get in, but neither SL5 nor a side-channel paper gives a universal percentage of capacity to give up. Measure the overhead on a matched workload and weigh it against the attack path it closes. The mistake is paying SL5’s tax for SL2’s threat (capital that returns more as goodput) or, far worse, paying SL2’s price and believing you have SL4’s protection. The target level is how you choose a point on that frontier deliberately rather than by accident. → goodput framing in Chapter 12.2.
Anti-patterns
The same mis-scopes recur because each comes from skipping the target-level question and reasoning from a control catalog or a compliance checkbox instead. Four are worth naming:
- Compliance as security. Treating SOC 2 attestation or ISO 27001 certification as evidence of an SL4 posture. These frameworks verify that controls exist and are operated; they do not establish that those controls thwart an OC4 adversary. A clean audit and a copied weight file are fully compatible.
- Perimeter thinking for a silent asset. Spending the security budget on fences, badges and ingress controls while the egress path the weights would actually leave through goes unmonitored and uncapped. You are guarding the entrance to a building whose crown jewel walks out the exit (→ Chapter 11.8).
- Over-defending the loud asset, under-defending the silent one. Hardening facility availability (which announces its own loss via an outage) to 2N-grade resilience while the weights (whose loss is silent and permanent) sit behind SL2 controls. Match the control to the loss signature, not to the dollar value alone.
- Budget-chosen levels. Picking a security level the organization can comfortably afford and assuming the adversary will scale down to match. Choosing SL2 because SL4 is expensive does not make your OC4 adversary go away; it leaves that attack path outside the claimed defense.
Choose the service and adversary before buying controls, and attach each acceptance result to its asset and owner. A lower-threat offering saves operating friction only while its intake excludes the higher-risk workload. Accepting frontier weights later without raising that boundary transfers an unpriced theft risk to the customer.
Cite this chapter
Fehn, J. (2026). Threat Model, Assets & Security Levels for AI Infrastructure (Chapter 11.1). The Definitive Guide to AI Data Centers. https://aidatacenterguide.com/part-11-security/11-1-threat-model-assets-and-security-levels-for-ai-infrastructure (accessed 2026-10-25).
@misc{aidc-11-1,
author = {Fehn, Jacob},
title = {Threat Model, Assets & Security Levels for AI Infrastructure (Chapter 11.1)},
howpublished = {The Definitive Guide to AI Data Centers},
year = {2026},
url = {https://aidatacenterguide.com/part-11-security/11-1-threat-model-assets-and-security-levels-for-ai-infrastructure},
note = {Accessed 2026-10-25}
}