Comment on The Emergent Symbolic Structure of Artificial Neural NetworksparentComments−squidbeak9dThis shows a deep misunderstanding of the paper's claims, which in no way challenge the established view that these bots are next-token predictors.No, this shows an appreciation of the symbolic richness behind that token 'prediction' which the paper leads on.Regardless, if all you want is a next-token selector, save your money and roll a die.Tell me, where is the emergent symbology guiding that dice?−chrisjj9dNo, this shows an appreciation of the symbolic richness behind that token 'prediction' which the paper leads on.The paper claims no symbolic richness beyond that evident from the undisputed next-token prediction.Tell me, where is the emergent symbology guiding that dice?There's none. That's my point.
Comments
No, this shows an appreciation of the symbolic richness behind that token 'prediction' which the paper leads on.
Tell me, where is the emergent symbology guiding that dice?
The paper claims no symbolic richness beyond that evident from the undisputed next-token prediction.
There's none. That's my point.