I can imagine that. I could probably fit more GPUs in my closet than the cost of my house.
Now imagine adding a complex liquid cooling system to my house, upgrading the wiring to support the extra power draw, and some full time staff to maintain the space and keep the GPUs running. Wouldn't be hard to switch the balance back away from GPUs toward the infrastructure around them.
And let's also imagine I include my massive GPU usage bill in the house column. And while we're at it let's also include my full time staff of researchers in the house column.
Well then we're left with the assumption that 100% of the new data center buildout will be done with Nvidia GPUs, with absolutely ZERO being AMD GPUs or google TPUs.
Comments
Imagine a house full of racks of gpus!
I can imagine that. I could probably fit more GPUs in my closet than the cost of my house.
Now imagine adding a complex liquid cooling system to my house, upgrading the wiring to support the extra power draw, and some full time staff to maintain the space and keep the GPUs running. Wouldn't be hard to switch the balance back away from GPUs toward the infrastructure around them.
And let's also imagine I include my massive GPU usage bill in the house column. And while we're at it let's also include my full time staff of researchers in the house column.
No way staff, complex liquid cooling and everything else is going to cost more than the hardware itself.
All articles that I found on "ai datacenters cost breakdown" say that >60% is for the HW inside.
Well then we're left with the assumption that 100% of the new data center buildout will be done with Nvidia GPUs, with absolutely ZERO being AMD GPUs or google TPUs.