Skip to content

Comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language Modelparent

Comments

Imagine you lived in a black room and all you can see is a buffer of text scrolling in front of you. Nobody explains what the symbols mean. You don't remember anything medium term, you can only access a short snippet of text at a time and form long term memories gradually. You just look and predict what will come next. Who could become an intelligent person being raised in these conditions?

So they are missing 2 years worth of visual, auditory, tactile and other modalities (grounding), having direct access to change their environment (embodiment) and being part of our society or an AI society (social).

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.