From Claude with some prompting
This image illustrates the internal architecture of the Nvidia H100 GPU. It shows the key components and interconnections within the GPU. A few key points from the image:
The PCIe Gen5 interface connects the H100 GPU to the external system, CPUs, storage devices, an
The NVLink allows interconnecting multiple H100 GPUs, supporting up to 6 NVlink connections with a 900GB/s bandwidth.
The GPU has an internal HBM3 memory of 80GB, which is 2x faster than the previous HBM2 memory.
Lechuck Park 