Comment on The "are you sure?" Problem: Why AI keeps changing its mindComments−trusche5moThis is real, but (at least in a coding context) easily preventable. Just append "don't assume you're wrong - investigate" or something to that effect. Annoying, but usually effective.−simsla5moI think my experience as an interviewer has helped. If you ask non-leading questions, sycophancy doesn't come into play as much.Instead of saying "are you sure?" or "shouldn't we do X instead?" you could say "give me the benefits and drawbacks of this compared to X".Also, when you yourself are sure, give clear stear. "This overcomplicates A, let's do B instead."−eru5moAlso: 'don't assume you are right.' I often have the models/agents make lots of assumptions and suffer from plenty of confirmation bias.
Comments
This is real, but (at least in a coding context) easily preventable. Just append "don't assume you're wrong - investigate" or something to that effect. Annoying, but usually effective.
I think my experience as an interviewer has helped. If you ask non-leading questions, sycophancy doesn't come into play as much.
Instead of saying "are you sure?" or "shouldn't we do X instead?" you could say "give me the benefits and drawbacks of this compared to X".
Also, when you yourself are sure, give clear stear. "This overcomplicates A, let's do B instead."
Also: 'don't assume you are right.' I often have the models/agents make lots of assumptions and suffer from plenty of confirmation bias.