MI300X
AMD's first broadly deployed AI GPU and the canonical case study in the gap between paper FLOPS and realized throughput once the software stack is accounted for.
Current numbers
192 GBMI300X HBM3 capacity per GPU, 2.4x the H100's 80 GB (5.3 TB/s, 750 W)