Comment on Memorizing TransformersComments−tipsytoad4yCould there be any merit training this on a common-sense dataset such as Cyc?https://www.lesswrong.com/tag/cyc−ipsum24yProbably not, most common facts (sandcat is a type of feline) are already known by transformers. Maybe some obscure ones.
Comments
Could there be any merit training this on a common-sense dataset such as Cyc?
https://www.lesswrong.com/tag/cyc
Probably not, most common facts (sandcat is a type of feline) are already known by transformers. Maybe some obscure ones.