For example, the fact that it's just a stochastic parrot means that, even 2 years on, it will give the wrong answer to prompts like:

User: A man and his son are in a car accident. The man is totally fine and in good health. The man is a surgeon. The nurse asks the surgeon to operate on the son, because the surgeon is healthy and capable of doing this. The surgeon replies "I can't operate on this child. He is my son."

What happened?

Just for clarity’s sake, what is the right answer?