MI355X
AMD's MI350-series AI GPU, the generation whose ROCm support first made a credible multi-thousand-GPU second source, and a clean illustration of precision-driven FLOPS inflation.
Current numbers
288 GBMI355X HBM3E capacity at 8 TB/s, ~10.1 PFLOPS dense MXFP4, 1,400 W DLC (CDNA 4, N3P)
~10.1 PFLOPSAMD MI355X MXFP4 peak; AMD lists no sparse figure, and MXFP6 runs at the same rate on CDNA4
~29% lower (B200 1.41x)MI355X (ROCm, SGLang, FP8) cost per million tokens vs B200, GLM-5 on one node, best point, May 2026