It is indeed possible that enough of its training material contains enough absurdities so that conversations like:
is X true?
of course, X is true.
I did not expect you to say that X is true.
I never said that X is true, it must be false.
to have it methodically lie.
Personally I believe that a rolling bullshit generator is more plausible; ChatGPT and GTP3 before it worked by producing plausible authoritative* answers; in its training it found out that saying true things is an efficient way not to mess up.
But otherwise it has no concept of truth; it was not trained on it. if we trained a ChatGPT inside of the Welcome to Night Vale universe it would give quite different answers.
* there is the extra strong condition of not causing bad PR for OpenAI
Comments
It is indeed possible that enough of its training material contains enough absurdities so that conversations like:
to have it methodically lie.
Personally I believe that a rolling bullshit generator is more plausible; ChatGPT and GTP3 before it worked by producing plausible authoritative* answers; in its training it found out that saying true things is an efficient way not to mess up.
But otherwise it has no concept of truth; it was not trained on it. if we trained a ChatGPT inside of the Welcome to Night Vale universe it would give quite different answers.
* there is the extra strong condition of not causing bad PR for OpenAI