Comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language ModelparentComments−dustfinger4yThe switch transformer has already achieved a trillion parameters.https://arxiv.org/abs/2101.03961
Comments
The switch transformer has already achieved a trillion parameters.
https://arxiv.org/abs/2101.03961