The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount
Guide › Glossary › H100

H100

NVIDIA's Hopper-generation data-center GPU; the chip behind most of the 2023–2024 buildout wave and the baseline many density and power comparisons start from.

Current numbers

~288 GBShipping Rubin GPU: 288 GB HBM4 at 19.2 TB/s, flat from B300; H100 80 GB; Rubin Ultra announced 1 TBas of 2026-10 · register ↗
80 → 288 GBPer-GPU HBM on shipping parts: H100 80 GB, HGX B200 180 GB, B300 288 GB, Vera Rubin 288 GBas of 2026-10 · register ↗
~$2.8/hrSilicon Data neocloud H100 rental index, October 2026 reading; it moves several percent a week, so re-pull before committingas of 2026-10-19 · register ↗

← All terms