GB300
NVIDIA's Blackwell Ultra rack generation (Grace CPU plus Blackwell Ultra GPUs) in NVL72 form; the density step between GB200 and the Rubin era.
Current numbers
≥54Tray-level liquid connections on a GB300 NVL72: 27 trays, each with a supply and a return. Excludes connections inside trays.
1.8 TB/s bidirectional (~0.9 TB/s per direction)NVLink 5 per-GPU bandwidth (~130 TB/s per GB200/GB300 NVL72 rack): ~18x GB200’s 400 Gb/s NIC, ~9x GB300’s 800 Gb/s
132 kW HPE GB200 nominal TDP / up to 142 kW GB300 full rack (NVIDIA)per dense training rack (HPE GB200 NVL72 ~132 kW nominal TDP; GB300 up to 142 kW in NVIDIA's RA)