They mean that K3's native floating point is MXFP4, a newer standard that's not supported in Hopper, an older nvidia chipset, so it's impossible the GPUs in question were Hopper (the article specifically mentions H200s), which is correct.
Probably either the author or the people they interviewed got the specific GPU details mixed up or wrong. Maybe it was B200s.
Notably, MXFP4 was introduced at the (much less costly) supervised fine-tuning stage after pretraining, so the number of B200/B300 GPUs could be relatively small in comparison to the number of H200 GPUs used during pretraining (or maybe not, who knows).
Comments
They mean that K3's native floating point is MXFP4, a newer standard that's not supported in Hopper, an older nvidia chipset, so it's impossible the GPUs in question were Hopper (the article specifically mentions H200s), which is correct.
Probably either the author or the people they interviewed got the specific GPU details mixed up or wrong. Maybe it was B200s.
Notably, MXFP4 was introduced at the (much less costly) supervised fine-tuning stage after pretraining, so the number of B200/B300 GPUs could be relatively small in comparison to the number of H200 GPUs used during pretraining (or maybe not, who knows).
(Kimi K3 tech report section 4.1.1 https://arxiv.org/pdf/2607.24653)
Oh, okay, thank you for the explanation. I was under the impression that we, the United States, were banning exports of such GPUs.