LLMs have no knowledge (really “knowledge-like weights and biases”) outside their training set and system prompt. That plausible justification is just that — a bunch of words that make sense when strung together. Whether you’d like to give that any epistemic weight is up to you.
More like whether one is correct in giving it any epistemic weight. Not everything is opinion, some things really are clearly right and clearly wrong and attributing thought, reasoning, and analysis to an LLM is one of those things that’s clearly wrong.
Comments
LLMs have no knowledge (really “knowledge-like weights and biases”) outside their training set and system prompt. That plausible justification is just that — a bunch of words that make sense when strung together. Whether you’d like to give that any epistemic weight is up to you.
More like whether one is correct in giving it any epistemic weight. Not everything is opinion, some things really are clearly right and clearly wrong and attributing thought, reasoning, and analysis to an LLM is one of those things that’s clearly wrong.