Having seen that LTT video the other day, most of these GPUs are installed in highly specialized racks with custom cooling solutions. The majority of these massive new datacenters probably use the custom OEM integrated H100s instead of the plug-and-play PCI card.
Comments
Having seen that LTT video the other day, most of these GPUs are installed in highly specialized racks with custom cooling solutions. The majority of these massive new datacenters probably use the custom OEM integrated H100s instead of the plug-and-play PCI card.
Not sure the one you are referring to, but I found a video for the H200. But the connectors seem reasonable for a desktop machine.
https://www.youtube.com/watch?v=lNumJwHpXIA