Comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language ModelparentComments−manquer4yThose are material science and physical limitations.Number of parameters in a neural network is not really limited that way, doing useful compute with it is a different matter
Comments
Those are material science and physical limitations.
Number of parameters in a neural network is not really limited that way, doing useful compute with it is a different matter