The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Security › 11.4

Chapter 11.4

In this chapter · 8 sections
Term help
Terms in this chapter (47)

Hardware Root of Trust, Firmware & BMC Security

An immutable silicon root can authenticate measured firmware evidence. Where the BMC controls host and device power, making it the anchor lets one rooted controller own the node below every defense and, over a flat management network, the rack. Test those powers and recovery paths.

ThreadsGoodputDensity ramp

What you'll decide here

  1. Compare Caliptra/DICE-based and proprietary shipped roots on immutable anchor, measurements, update enforcement, reference authority and recovery evidence. Openness alone is not assurance.
  2. Require attestable measured boot and a signed Reference Integrity Manifest (RIM) for every component before a node joins, or trust it because it powered on.
  3. Segment and credential BMC/DC-SCM management, including IPMI and Redfish: its standby-powered processor can keep control while the host OS is down.
  4. Enforce accepted signatures and security-version rollback policy on update and recovery paths; no unauthorized TFTP or update path may plant persistent code below the OS.
  5. Which continuous firmware-integrity monitoring to run post-boot, and whether a confirmed implant means re-flash and re-attest or RMA. Measured boot proves state once, at t=0.

Every security control in Part 11 (confidential computing, network microsegmentation, weight encryption, multi-tenant isolation) is software running on firmware that booted before any of it existed. If that firmware lied about what it loaded, none of the controls above it mean anything. That makes firmware the highest-value target in the building. It is the most privileged code, running before and beneath the hypervisor and the OS. It is the most persistent. A BMC or SPI-flash implant outlasts an OS reinstall and a disk wipe, and firmware on a part that travels with the chassis (a pluggable management module, a NIC, a GPU) can even outlast a board replacement. And it is the least observed, because EDR, your SIEM and your GPU telemetry all live above it and cannot see it. An attacker who plants a backdoor in the BMC has not compromised a server. They have compromised everything that server will ever run, invisibly, for the life of the asset.

The rest of the chapter is a decision framework for the layer beneath the OS. It starts with why firmware is the target and what a hardware root of trust (RoT) buys: the silicon-anchored chain that gives every higher claim, including the GPU attestation of Chapter 11.5, its meaning. Next come secure and measured boot, firmware-update integrity and platform attestation, the machinery that lets a node prove to your fleet, not just to itself, what it is running. The BMC gets treated as the parallel computer it is, with its own threat model and segmentation discipline. The chapter closes on continuous integrity monitoring, because measured boot is a snapshot and an AI cluster runs for years.

Why firmware is the high-value target

Generic IT threat models treat firmware as a footnote because, on a fleet of fungible web servers, a bricked node is a ticket and a re-image. In an AI data center the economics invert, for three reasons. First, the asset is irreplaceable and supply-constrained. A GB200 NVL72 rack is about $3.1M server-only in the August 2025 hyperscaler model, with a separate accelerator-allocation constraint, and the GB300 NVL72 racks filling 2026 halls sit in the same allocation queue. An attacker who can brick one from the management plane holds a destructive weapon with grid-trip-adjacent leverage (the OT/destructive angle is Chapter 11.10). Second, the asset carries the highest-value digital IP in existence, frontier weights, and a firmware implant sits below the encryption boundary meant to protect them, with a clear line of sight to plaintext in host memory and over PCIe (weight protection is Chapter 11.8). Third, firmware is persistent and stealthy in a way nothing above it is: an implant in the BMC or in SPI-resident UEFI survives every remediation short of physical re-flash, and it is invisible to the detection stack you built for the OS and the network.

This is not hypothetical. The canonical example arrived in 2025: CVE-2024-54085, an authentication bypass in AMI's MegaRAC BMC firmware, scored CVSS 10.0 and was added to CISA's Known Exploited Vulnerabilities catalog on 25 June 2025. MegaRAC is OEM'd into BMCs across a dozen-plus server vendors. A remote, unauthenticated attacker who reaches the Redfish interface can deploy malware, tamper with firmware, brick the BMC or BIOS, and force unrecoverable reboot loops. Because BMCs on a flat management segment can command their neighbors, the attacker can also pivot to every other BMC on the same VLAN. Eclypsium reported roughly 1,000 internet-exposed instances on 18 March 2025; that search establishes exposure, not exploitability or compromise of every device. The BMC stack a server runs, whether a proprietary one like MegaRAC that reaches you through the OEM or open-source OpenBMC, decides who ships the fix for a flaw like this and how fast it reaches your fleet (Chapter 8.7). The most privileged, most persistent, least-watched computer in the rack shipped with a CVSS 10.0.

Silicon root of trust: anchoring the chain in hardware you can audit

A root of trust is the first piece of code that executes and is trusted without being measured by anything else. It is the anchor the whole boot chain hangs from. The fork is where that anchor lives and who can audit it. The legacy posture roots trust in a vendor's opaque boot ROM and BMC firmware: you trust it because the OEM says so, and you cannot inspect it. The design the hyperscalers are pushing through OCP roots trust in an open, immutable, dedicated silicon RoT that boots first, measures everything else, and has an implementation you can read.

The reference design is Caliptra, an open-source silicon RoT specification contributed to OCP by Microsoft, Google, AMD and NVIDIA in 2022 and now developed under CHIPS Alliance. AMD has committed to integrate it from its 2026+ products. Confirm per part whether the shipped silicon carries Caliptra or a proprietary root. Caliptra is an internal RoT: a hardware block inside the SoC, not a discrete TPM hanging off a bus an attacker can interpose on. It establishes a cryptographic device identity and measures the first mutable firmware before it runs. The identity mechanism is DICE (Device Identifier Composition Engine): starting from a Unique Device Secret fused into the silicon, each boot layer derives the next layer's identity as a function of its own measured code.

By design, changing even one bit of any layer's firmware changes every key derived after it, so a tampered boot chain cannot reproduce a clean chain's attestation. Implementations can still break that property. In August 2026 the Caliptra project published an advisory for its Core ROM (CVE-2026-11835). It affects ROM 2.1.0 and 2.1.1 in subsystem mode, is rated medium, and is fixed in ROM 2.1.2. An attacker who already controls the companion microcontroller's firmware could change the image after verification, and attestation would still report the original digest. The project issued several other advisories in 2026. Because ROM is burned into the silicon, ask which ROM release your part carries and check it against the advisory list.

Caliptra 2.x (the 2025 line) adds something the long-lived-asset thesis of this guide demands: post-quantum cryptography in the root itself. With 2.1 (October 2025), the open-source Adams Bridge accelerator implements NIST's ML-DSA (signatures) and ML-KEM (key encapsulation) with side-channel countermeasures. Caliptra 2.2 is announced and scheduled for release in December 2026 (Microsoft, 13 October 2026). It halves the Adams Bridge area with a fully masked design and adds a USB controller for streaming boot, dual-core lockstep, control-flow monitoring and hardened PCRs. Until it ships, 2.1 is the latest released line, so ask which Caliptra release and ROM version your 2027 parts carry. ML-KEM protects long-lived ciphertext confidentiality against harvest-now-decrypt-later collection; ML-DSA protects future signature authenticity against forge-later attacks. For a GPU asset on a 5-6 year book life, whose encrypted secrets must stay confidential and whose attestation signatures must stay authentic across the PQC transition, rooting trust in pre-quantum crypto is a slow-motion mistake. The crypto-agility forward-pointer for weights and long-lived keys is in Chapter 11.8.

Root-of-trust posture: where the anchor lives, and what each fork costs you
PostureAnchorAuditabilityAttestation strengthPersistent-implant resistanceBest fit
Vendor BMC / boot-ROM onlyOpaque OEM firmware, mutable flashNone — proprietary, un-inspectableWeak: trust-by-assertion, no measured chainLow — implant in BMC/SPI survives OS wipeLegacy fleets; not defensible for frontier assets
Discrete TPM 2.0External crypto module on LPC/SPI/I2C busSpec-open, but a separate chip on an interposable busModerate: PCR measured boot, but bus is an attack surfaceModerate — host firmware still mutable; bus interposition possibleEnterprise baseline; pair with internal RoT, not alone
Open silicon internal RoT (Caliptra/DICE)Immutable RoT block inside the SoC; UDS-fused identityHigh — open-source RTL and firmware. The public S.A.F.E. reviews (NCC Group 2023, IOActive 2024) examined firmware only, and none covers the RTL or the 2.x line, so request a review of the exact release you buyStrong: DICE layered identity, one-bit change breaks the chainHigh — first-mutable-firmware measured before it runsNew data-center SoCs where the vendor can show Caliptra in the shipped part
Internal RoT + PQC (Caliptra 2.x + Adams Bridge)Internal RoT with ML-DSA/ML-KEM in hardwareHigh — open, side-channel-countermeasured PQCStrong: ML-DSA protects signing and attestation against forge-later signature attacksHigh — first mutable firmware is measured before it runsLong-lived assets needing forge-later-resistant signatures and HNDL-resistant key establishment
Where platform trust is anchored is a decision fork. Caliptra/DICE entries follow the OCP and CHIPS Alliance specs. A discrete TPM (for example the Infineon SLB 9672) is the baseline that DC-SCM 2.0 designs commonly pair alongside the root.

Read the table as a decision, not a catalog. A discrete TPM supplies particular evidence, not a complete platform defense. It gives you PCR-based measured boot, but it is a separate chip on a bus an attacker with physical access can interpose on, and it does not protect the host's own mutable firmware from modification before the next boot measures it. An internal silicon RoT can shrink the exposed trust boundary: it lives inside the package and can authenticate and measure the first mutable firmware before execution. Verify coverage and enforcement in the shipped implementation. One implementation uses both: a discrete TPM 2.0 for the platform measured-boot PCRs and an internal RoT (Caliptra-class) anchoring the silicon identity. A DC-SCM 2.0 label alone establishes neither that integration nor complete coverage. At the October 2026 OCP Summit, Microsoft demonstrated another arrangement: the host TPM moves into the BMC's root-of-trust co-processor, the host keeps its standard TPM interface, and measurements stay readable out of band when the host OS is down. It is a demo with published source code, not a shipping product. The nine-axis matrix below asks what each mechanism covers and what admission does when its evidence fails.

Nine-axis root-of-trust acceptance matrix
Fixed axisThreat boundaryEvidence and testFailed-admission outcome
Immutable anchorUnsigned first-stage code; editable verifier defeats every later signature.Identify the immutable or protected first verifier and who can alter its trust keys.Unsigned boot succeeds, or anchor ownership is unexplained: quarantine.
Measured componentsA genuine host quote can omit a compromised BMC, GPU or NIC.Map each component to its measurement agent and authenticated evidence.Any required component lacks coverage: deny the service requiring it.
Identity evidenceA valid certificate can describe another server or a replaced board.Bind issuer chain, device identity and purchase serial; test substitution.Substituted device is accepted: hold receiving and investigate custody.
Reference valuesSigned measurements of an old vulnerable release remain authentic.Authenticate exact release baselines and minimum security versions.Revoked or mismatched baseline passes: deny secret release.
Verifier interfaceA valid cached report can be replayed to another session.Name protocol/version, challenge freshness and recipient/session binding.Replayed or redirected evidence passes: close the admission path.
RecoveryA protected boot path can recover into a revoked image.Interrupt update; recover to approved state and re-attest all required components.Recovery returns below policy or cannot be verified: keep the node out.
Update and revocationA lost signing key or expired support can leave no safe update route.Name key owner, revocation distribution, lifetime and replacement remedy.Revoked signer/version remains accepted: freeze rollout and admissions.
Independent reviewSource access or a brand name can hide a gap in the shipped configuration.Bind the report to hardware, firmware, tested threat scope and open findings.Required scope is absent or unresolved: withhold acceptance.
Handover decisionA passing factory test can be detached from the installed server.Bind identity, manifest, test artifacts, policy version and responsible owner.The installed state differs or the acceptance record is incomplete: quarantine.
Apply every axis to each candidate in the comparison above. A TPM, a vendor BMC root and an open SoC root each supply different parts of this chain, and the integrator must demonstrate the missing platform pieces. The axes draw on NIST SP 800-193 (May 2018) and DMTF SPDM DSP0274 1.4.1 (2 July 2026): https://csrc.nist.gov/pubs/sp/800/193/final; https://www.dmtf.org/standards/spdm. These are procurement tests, not claims that any product passed them.

DC-SCM: physically decoupling management from the motherboard

The OCP Datacenter-ready Secure Control Module (DC-SCM) is the architectural answer to the BMC-as-liability problem. Instead of soldering the BMC, the RoT and the TPM onto the motherboard, where they are tied to that board's design, firmware lifecycle and supply chain, DC-SCM moves all of the management, security and control logic onto a pluggable module that mates to the host board over a standard connector. The 2.x generation (2.1 in 2023, now Rev 2.2 from September 2025 with LTPI 1.2; a DC-SCM 3.0 sub-project has started) standardizes the horizontal external form factor and the interfaces, so the same security module can ride across multiple board generations and multiple-node designs. The OCP MGX 1.2 specification (effective 6 October 2026) adds a compact module that stands vertically in a 1RU tray. It uses the same SFF-TA-1002 connector but only a subset of the DC-SCI pins, so check form factor and pinout before moving a module between an MGX tray and a standard 2.x slot. Between the host board and the module, OCP's OBMF-ICP 1.0.0 (7 October 2026) carries GPIO, I2C, UART, SPI, TPM and IPMI traffic as channels over one link such as USB. It has no encryption of its own, so a TPM or other sensitive channel needs its own protection or an SPDM session.

The consequence is threefold. First, supply-chain provenance (Chapter 11.3) gets a clean boundary: the security-critical components (RoT, BMC, TPM) live on one auditable module you can source, attest and update on its own cadence, instead of being entangled with a commodity motherboard. Second, firmware lifecycle decouples: you can refresh or harden the management stack without re-validating the entire server, which matters when a 10.0 BMC CVE lands mid-deployment. Third, the management plane becomes a discrete, attestable unit. The RoT on the DC-SCM measures and gates the BMC's own firmware, so the controller with god-mode over the host is itself rooted in silicon you trust. The leading modules pair an internal RoT, an ASPEED AST2600/AST2700-class BMC and a discrete TPM 2.0 on one card, which is the layered posture the table above argues for, productized.

Secure boot, measured boot, and the chain that makes attestation real

Two mechanisms are routinely conflated, and they do opposite jobs. Secure boot is enforcement: each stage cryptographically verifies the signature of the next stage before executing it and refuses to run anything unsigned or tampered. It is a gate that stops a known-bad boot. Measured boot is evidence: each stage hashes the next stage and extends that hash into a tamper-resistant register (a TPM PCR or the RoT's measurement log) before passing control. The result is a cryptographic transcript of exactly what ran, in order. It stops nothing; it produces a tamper-evident record you can attest against later. You want both. Secure boot keeps the obvious attacks out. Measured boot lets you prove to a remote verifier what actually loaded, which is the only way a fleet can make a trust decision about a node it cannot physically inspect.

The chain runs RoT → platform firmware (UEFI/BIOS) → bootloader → OS kernel → the workload's own attestation, and, in parallel, RoT → BMC firmware. The NIST backbone is SP 800-193 (Platform Firmware Resiliency): protect, detect, recover. It comes with SP 1800-34 (supply-chain provenance) and IR 8320 (hardware-enabled security). Whether any of this defends anything depends on one decision: do you enforce on the measurement? That means a node enters the cluster, receives weights and gets traffic only after its measured-boot quote validates against a known-good golden value. If measured boot produces a log nobody checks, you have built an audit trail for the forensics team, not a defense.

Firmware-update integrity: signed, versioned, anti-rollback

The update path is where a firmware defense most often fails quietly. Update is the one sanctioned way to change the code below the OS, so it is the channel an attacker most wants. Three properties are non-negotiable. Signed: the platform refuses any image not signed by a key chained to the RoT, with no unsigned TFTP pushes and no vendor-tool side-loads. Versioned and anti-rollback: the hardware enforces a monotonic security version counter, so an attacker cannot downgrade you to a known-vulnerable firmware and re-open a patched hole. Verify that trusted hardware enforces the counter and how recovery treats it; the security version need not equal a marketing release number. Atomic and recoverable: a failed or interrupted update must leave a known-good image to boot from (the A/B or golden-recovery pattern SP 800-193 calls for). Demonstrate it with interruption tests on the shipped platform. That turns a failed or interrupted update into a recoverable event; it does not protect the node from denial of service.

Test the verifier, not the checkbox. In September 2025 Binarly disclosed that Supermicro BMC images could redirect signature checking to tables placed in unsigned space (CVE-2025-7937 and CVE-2025-6198), so an attacker with admin access could install persistent firmware past the BMC root of trust. Ask whether the verifier fixes the signed layout itself or trusts one the image describes, whether every boot stage including the kernel is authenticated, and how signing keys are scoped: per product line, or one key for the whole ecosystem.

At fleet scale the available interfaces include Redfish for the management API, PLDM-over-MCTP for component firmware update, and the OCP GPU Firmware Update specification for cross-vendor GPU firmware management over a secure out-of-band path. Getting this wrong has a severe and specific consequence: a fleet that accepts unsigned or downgradeable firmware has handed an attacker, or a poisoned supply-chain update, a way to make a backdoor resident below the OS and persistent across remediation. If the patch channel is compromised, use an independently trusted recovery path. Preserve anti-rollback enforcement during recovery; where downgrade is forbidden, test forward recovery or replace the unit. A second A/B image does not help when a compromised signing key or the same corruption reaches both copies. Streaming boot, which Microsoft developed with OCP, lets devices run without local firmware flash: firmware arrives over I3C, USB or PCIe, and the device authenticates and measures it in isolated memory before it runs. Boot and recovery then share one path. Microsoft calls streaming boot a default Caliptra capability and demonstrated it over USB at the October 2026 OCP Summit.

CVSS 10.0
CVE-2024-54085 AMI MegaRAC BMC auth-bypass via Redfish; added to CISA KEV 25 Jun 2025; OEM'd across 12+ server vendors
4 contributors
Caliptra open silicon RoT, co-developed by Microsoft, Google, AMD and NVIDIA; AMD plans to integrate it from 2026+ products
Scope & caveats

AMD's commitment is a plan. No public source names a shipping data-center part with Caliptra, so check per part whether the silicon carries Caliptra or a proprietary root.

Caliptra 2.1: ML-DSA + ML-KEM
Caliptra 2.1 reference IP supports ML-DSA and ML-KEM; verify selected options in the shipped device
Scope & caveats

Reference IP capabilities; implementation options and product integration must be verified for the shipped platform. Caliptra 2.1 is the latest released minor line as of 2026-10-17 (RTL v2.1.2; ROM 2.1.3 and FW 2.1.4 patch releases, combined release 2026-10-09). Caliptra 2.2 is announced and scheduled for release in December 2026 (Microsoft, 2026-10-13). Core ROM 2.1.0 and 2.1.1 had a secure-boot bypass (CVE-2026-11835), fixed in ROM 2.1.2, so check the ROM release in the shipped silicon.

800-193
NIST Platform Firmware Resiliency (protect/detect/recover); with SP 1800-34 and IR 8320 the standards backbone for firmware integrity
DC-SCM Rev 2.2
DC-SCM puts BMC, RoT and TPM on a pluggable module; Rev 2.2 (September 2025) is the current specification
Scope & caveats

Rev 2.2 pairs with LTPI 1.2 (LTPI is now a standalone specification). DC-SCM 2.1 (2023) is the previous specification revision; Project Argus is a DC-SCM 2.0-compliant module design contribution, not a specification revision. DC-SCM 3.0 is an OCP sub-project with no published specification as of 2026-10-19. OCP MGX 1.2 (effective 2026-10-06) adds a compact vertical 1RU module on the same SFF-TA-1002 connector with a subset of DC-SCI pins.

always-on
BMC runs on standby power and boots before the host; rooted, it is an OS-invisible persistent foothold under the CPU
Deep dive: the BMC threat model and how the management plane goes fleet-wide

The BMC's danger is the product of its privilege and its connectivity. On privilege: out-of-band, it can read and write host memory regions, re-flash the host BIOS/UEFI, control power and reset, and read every platform sensor, all without the host OS knowing. On connectivity: in the default deployment it shares a management network with every other BMC, and IPMI's legacy auth is notoriously weak (the cipher-zero and RAKP hash-disclosure flaws are a decade old and still found in the field). Combine the two and you get the MegaRAC failure mode. A single auth bypass on one Redfish interface lets an attacker own that host beneath its OS and also issue commands to every neighboring BMC on the flat segment, forcing all of them into unrecoverable reboot loops or flashing implants across the fleet. The blast radius is the management VLAN, and on most fleets that VLAN is large and flat.

An AI rack is not one BMC, so count the controllers before you size the segment or the golden store. NVIDIA's DGX GB200 user guide (updated September 2026) lists three kinds of BMC in one NVL72 rack. Each of the 18 compute trays has a BMC working with a Host Management Controller, and carries two BlueField-3 DPUs with their own BMC ports. Each of the 9 NVLink switch trays has a BMC for attestation and recovery. That is 63 BMCs on one rack's management network before you count the Host Management Controllers, the eight power shelves or any OEM rack controller. Each kind of BMC adds one firmware lineage to the golden-measurement store, but every one of the 63 sits on the management plane as a separate host. On a flat segment, a rooted BMC can reach the other 62 in the rack and every BMC in neighboring racks. Other OEM builds and later generations change the counts; take them from your OEM's rack management guide, and ask how the power-shelf controllers are reached and updated.

The defense is segmentation plus rooting. Segmentation: the management plane is its own physically or logically isolated network, unreachable from tenant or production traffic and from the internet, ideally behind a jump host with its own MFA. Chapter 11.7 generalizes this management-plane isolation to the whole fabric and DPU-enforced microsegmentation. Rotate default credentials at provisioning, and disable IPMI in favor of authenticated Redfish where possible. Rooting: the RoT measures and gates the BMC's own firmware (the DC-SCM pattern), so the controller with god-mode is itself attestable, and continuous monitoring (below) watches its flash for post-boot change. Together they turn 'a CVE in our BMC vendor' from a fleet-wide extinction event into a patch-and-re-attest cycle on an isolated plane.

Platform attestation: proving state to the fleet, not just to yourself

Local measured boot answers 'what did I load?' Remote attestation answers the question the cluster actually needs: 'should I trust that node enough to give it weights and traffic?' The flow: a verifier issues a challenge and the node returns signed evidence from its supported RoT/TPM interface. The verifier obtains authenticated per-component Reference Integrity Manifests (RIMs), the vendor-signed golden hashes of legitimate firmware, and compares the quote against known-good values for that exact hardware and firmware version. If policy matches for the complete required evidence, the node may be admitted and, in a confidential-computing deployment, a key broker releases the keys that decrypt the workload's data only to an attested node. If the evidence mismatches, is invalid, or verification is unavailable, hold admission and classify the cause. The DMTF SPDM editions — DSP0274 1.4.1 (2 July 2026), DSP0277 2.0.0 and DSP0289 1.0.0 (8 December 2025), DSP0294 1.0.0 (31 August 2026) — describe available interfaces; your acceptance record must name the protocol and version the platform actually implements.

This platform attestation is the foundation under the GPU attestation of Chapter 11.5. NVIDIA's device-identity certificate chain and NRAS/RIM verification establish that the GPU is genuine and running attested firmware. But a confidential-computing claim is only as strong as the host platform underneath it: a compromised BMC or tampered host firmware remains an availability or unprotected-platform threat even when the GPU evidence passes. A confidential release must compose the required CPU/CVM, GPU and workload evidence; skip the platform layer and you have built a tall trust chain on an unverified foundation. One open way to compose the platform part is Microsoft's Composite Entity Attestation Token (EAT), which Microsoft said on 13 October 2026 it has contributed to OCP. The BMC collects fresh evidence from CPUs, GPUs, drives and NICs, and its root of trust binds that evidence to the BMC's own measurements in one signed platform token; reference code ships in ASPEED and Nuvoton BMC and RoT SDKs. Ask whether your BMC emits it and which verifier appraises it. The caveat, expanded in Chapter 11.5: attestation proves provenance and integrity at boot, not the absence of every side channel or a benevolent operator. It is a necessary foundation, not a panacea.

Continuous firmware-integrity monitoring: because boot is a snapshot

A fresh quote over boot-time measurements does not, by itself, remeasure runtime state at minute 10,000. That limitation defeats a measured-boot-only posture. A fleet can keep nodes running for long intervals between measured boots, and runtime firmware exploits, malicious post-boot updates and physical tampering all happen after the boot measurement is taken and signed. A defense that attests at boot and never looks again is blind to exactly the persistent implant that firmware attacks are designed to plant. The mature posture adds continuous integrity monitoring: supported runtime remeasurement and fresh attestation of the objects each mechanism actually covers, watching SPI flash and BMC firmware for unauthorized change, and feeding anomalies into the SOC's detection coverage (Chapter 11.12) and the GPU/host telemetry pipeline (Chapter 10.6).

The OCP S.A.F.E. (Security Appraisal Framework and Enablement) program is the supply-side complement to runtime monitoring. It standardizes independent third-party security audits of device firmware by accredited Security Review Providers, and produces cryptographically signed, machine-readable short-form reports that identify the vendor, device and firmware by hash. It does not watch your fleet at runtime. It raises the floor on the firmware you onboard, so 'the firmware we shipped was independently audited' becomes a procurement requirement (the supply-chain framing is Chapter 11.3) rather than a vendor's promise. The two fit together: S.A.F.E. and signed RIMs establish what good looks like at intake, and runtime monitoring can detect drift in what it covers, while unmeasured state remains a residual gap.

Deep dive: building the golden-measurement pipeline (the part everyone underestimates)

The architecture diagrams make attestation look clean: the RoT measures, the verifier checks, done. The operational reality is a data-management problem that scales with your fleet's heterogeneity and refresh cadence, and it is where most attestation programs stall. To gate admission on measurements, you must keep a current, authoritative store of every valid golden measurement: every component (CPU microcode, UEFI, BMC, GPU VBIOS/firmware, NIC firmware, CPLD, the DC-SCM stack), every firmware version legitimately deployed, across every hardware generation in the building. Every sanctioned firmware update changes a valid measurement. If the golden store and the update pipeline are not tightly coupled, the gate starts rejecting nodes you legitimately patched, operators start whitelisting to stop the pages, and within a quarter the gate is decorative.

This is the cost of a mixed-generation fleet in operational terms. A fleet spanning H100, H200, B200, GB200, GB300 and Vera Rubin NVL72 (shipping since June 2026), each with its own NIC and BMC firmware lineage, multiplies the set of valid measurements every refresh cycle. Four disciplines keep it tractable. Ingest vendor-signed RIMs directly into the golden store as the source of truth, and don't hand-curate hashes. Drive firmware updates and golden-store updates from the same signed pipeline so they cannot diverge. Alert on unexpected change, not every change, by reconciling against the update system of record. And stage a tested re-flash-and-re-attest runbook, so a confirmed implant has a remediation path short of RMA. Get the pipeline right and attestation-as-a-gate is sustainable. Get it wrong, and the pressure to silence false quarantines turns your strongest firmware control back into a logbook.

Whatever pushes firmware updates, stores the approved baseline and decides admission becomes the most privileged system you operate, because whoever controls it controls what every node runs and which nodes count as trusted. Isolate it on the management plane, split its signing and verification credentials, attest it like any node, and patch it on a BMC schedule. NVIDIA's open-source Infrastructure Controller does part of this work. It plans out-of-band firmware pushes, holds hosts to a firmware baseline and, once attestation is enabled, validates measured-boot quotes. In September 2026 NVIDIA fixed hard-coded credentials in it (CVE-2026-65113, CVSS 9.8, versions 0 through 1.9, fixed in 2.0).

The decision, distilled

Firmware security is a posture you commit to at procurement and enforce on every boot; it is not a product you buy. The forks compound: an open silicon RoT or a vendor black box; a discrete TPM alone or paired with an internal RoT on a DC-SCM; attestation as a gate or as a logbook; signed, anti-rollback updates or a fleet that trusts any push; boot-time measurement only or continuous monitoring; PQC-ready roots or pre-quantum keys on a 5–6-year asset. Choose the weak side of each and you have not saved money. You have built every higher control in Part 11 on a layer that can lie, on assets too valuable to brick and too IP-rich to wiretap, with a detection stack that cannot see the one place a real adversary will live. The MegaRAC 10.0 was the cheap lesson; the expensive one is the implant nobody finds for years.

This chapter is the foundation the rest of Part 11's stack rests on. The threat model and the Weights-Security-Level framing that values these assets are in Chapter 11.1; the kinetic and physical threats to the same silicon are in Chapter 11.2; supply-chain provenance and S.A.F.E. at intake are in Chapter 11.3. Platform attestation here is the base layer under GPU confidential computing and the NRAS/RIM attestation flow in Chapter 11.5. The management-plane isolation argued in the BMC deep dive generalizes to DPU-enforced microsegmentation in Chapter 11.7. Firmware as a foothold below the weight-encryption boundary connects to Chapter 11.8, where the PQC and key-hierarchy threads also resolve. Firmware weaponized for destruction (GPU bricking, forced load steps) is the OT/cyber-physical case in Chapter 11.10. Runtime integrity feeds detection in Chapter 11.12 and the telemetry pipeline in Chapter 10.6.
Cite this chapter
Fehn, J. (2026). Hardware Root of Trust, Firmware & BMC Security (Chapter 11.4). The Definitive Guide to AI Data Centers. https://aidatacenterguide.com/part-11-security/11-4-hardware-root-of-trust-firmware-and-bmc-security (accessed 2026-10-25).
@misc{aidc-11-4,
  author       = {Fehn, Jacob},
  title        = {Hardware Root of Trust, Firmware & BMC Security (Chapter 11.4)},
  howpublished = {The Definitive Guide to AI Data Centers},
  year         = {2026},
  url          = {https://aidatacenterguide.com/part-11-security/11-4-hardware-root-of-trust-firmware-and-bmc-security},
  note         = {Accessed 2026-10-25}
}
Spotted an error? Suggest an edit