One of the weirdest side efects of 4o vs 4, was single character "hallucinations" where a completely correct answer would be wrong specifically by a single character
I don't think I've seen anyone comment on it, but it was noticeable, specially when 4o was just released
Has anyone noticed anything similar?
I noticed the same problem but on 4, it was super-weird, everything was fine except one character, and it occurred consistently in the second and the next answers, never in the first one.
i saw this with github copilot a few days ago, not sure which model it was. it messed up a single character of markup causing the resulting output to be formatted weirdly
Comments
One of the weirdest side efects of 4o vs 4, was single character "hallucinations" where a completely correct answer would be wrong specifically by a single character
I don't think I've seen anyone comment on it, but it was noticeable, specially when 4o was just released Has anyone noticed anything similar?
Interesting. They switched to a new tokenizer for 4o and 4o-mini, so this might have the same issue.
I noticed the same problem but on 4, it was super-weird, everything was fine except one character, and it occurred consistently in the second and the next answers, never in the first one.
i saw this with github copilot a few days ago, not sure which model it was. it messed up a single character of markup causing the resulting output to be formatted weirdly