Skip to content

Comment on How LLMs Work, Explained Without Mathparent

Comments

Point is that the simplest way to excel in next token prediction in the way human consider correct - which is rated by how people feel the predictor mimics a human understanding - is to actually have a world model and other components of human understanding.

This is a speculative theory for why a next token predictor might sound like it knows what it's talking about. Not something we actually know.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.