Comment on Infrastructure setup and open-source scripts to train 70B model from bare metalComments−alias_neo2yThis post focuses on one cluster that had 4,092 H100 GPUs spread across 511 computers, with eight GPUs to a computerAm I right in understanding, that's over $100 Million worth of GPUs?I wonder what/when/if any of this will be within the realms of an enthusiast with a gaming-pc budget.−ec1096852y100M in GPUs and they are futzing with dell boxes that have bad Ethernet ports.Interesting to hear about all the problems they ran into!−freeqaz2yLooks correct. They raised $200m from NVIDIA which I presume is in pure GPUs. https://news.crunchbase.com/ai-robotics/new-ai-unicorn-imbue...−mandeepj2yAm I right in understanding, that's over $100 Million worth of GPUs?Ha! I guess most or many of the readers (who don't have that much of funding) should jump to the next HN submission
Comments
Am I right in understanding, that's over $100 Million worth of GPUs?
I wonder what/when/if any of this will be within the realms of an enthusiast with a gaming-pc budget.
100M in GPUs and they are futzing with dell boxes that have bad Ethernet ports.
Interesting to hear about all the problems they ran into!
Looks correct. They raised $200m from NVIDIA which I presume is in pure GPUs. https://news.crunchbase.com/ai-robotics/new-ai-unicorn-imbue...
Ha! I guess most or many of the readers (who don't have that much of funding) should jump to the next HN submission