AI Power is key foundation as Huang said.
How many flops per W is another key cost for TCO of AI.
Exp. in LLM, pretrain and serving cost running on the AI power foundation, the ratio between USA-China is about ~0.053 VS ~0.13 USD/kWh. US cost is ~20%-2.4x larger than China.
So, in this game at the basic AI power layer, US way lagged behind.
Mark Zuckerberg's Meta so far is lowest ROI in the race of LLM foundation, so why he dis approves is reasonable. Meta is touching the Bottom boundary of ROI in LLM.
Comments
AI Power is key foundation as Huang said. How many flops per W is another key cost for TCO of AI.
Exp. in LLM, pretrain and serving cost running on the AI power foundation, the ratio between USA-China is about ~0.053 VS ~0.13 USD/kWh. US cost is ~20%-2.4x larger than China.
So, in this game at the basic AI power layer, US way lagged behind. Mark Zuckerberg's Meta so far is lowest ROI in the race of LLM foundation, so why he dis approves is reasonable. Meta is touching the Bottom boundary of ROI in LLM.
Ref: https://energyandclimateindex.com/en/u-s-electricity-prices-...
Because he's not the center, presumably.