Skip to content

Comment on Data Compression Explained (2012)parent

Comments

True, but it's not relevant because that isn't how we actually train LLMs for use as quasi-intelligent tools. We specifically do not want the model to be able to just memorize its input, which is what your process requires.

Many things about the process are similar, so there's some analogy, but it just isn't the same.

This is the one area where you actually want an LLM to be “nothing but a fancy auto-complete” like so many people say it is.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.