Comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language ModelComments−putlake4yChina's WuDao model had 1.75T parameters and Google's Switch transformer had 1.6T. How is this the world's largest then?
Comments
China's WuDao model had 1.75T parameters and Google's Switch transformer had 1.6T. How is this the world's largest then?