Well, the Fable guardrails breaks this argument, as when you get booted down to Opus 4.8 it still happily responds (as does most other models after a "I'm not a doctor but..." hedge).
So you get to press the big red button anyways, you just get downgraded to stupider advice, increasing the risk of catastrophy and lawsuits.
But the whole point is that the models are so good now anyways that any stupidity will most likely be from the user misunderstanding the output...which already happens all the time with humans.
Comments
Well, the Fable guardrails breaks this argument, as when you get booted down to Opus 4.8 it still happily responds (as does most other models after a "I'm not a doctor but..." hedge).
So you get to press the big red button anyways, you just get downgraded to stupider advice, increasing the risk of catastrophy and lawsuits.
But the whole point is that the models are so good now anyways that any stupidity will most likely be from the user misunderstanding the output...which already happens all the time with humans.