Yeah. In my particular narrow field of expertise -- which, broadly speaking, is a subset of mechanical engineering -- I can say for a certainty that it's nowhere near PhD-level, and it's not perceptively smarter than o3-pro. Maybe it's slightly smarter, but honestly it's hard to tell.
I can confirm in head-to-head tests that Kimi is a far better prose stylist. I asked both models to write me a poem in the style of Ezra Pound's Canto I. Kimi's one-shot result was excellent; an "A+" effort at any school in the world, and genuinely professional-poet-tier. (Rather frightening, that.) GPT-5-Pro's result was a disaster that was so bad it verged on parody, and to add insult to injury it sometimes plagiarized Pound's Canto I word-for-word.
I will say that GPT-5 seems a little bit more imaginative and inventive than previous models. It seems slightly better than all other models at formal logic, to the extent that it's a superhuman analytic philosopher. It's also better and faster at searching the web, and it's a little bit more circumspect than usual about the results it shares. (It doesn't blindly promote every product.)
Ultimately this seems like a very incremental upgrade, but it's an upgrade nonetheless.
Comments
Do you still hold the same opinion about GPT-5 Pro now that a day has elapsed and you've had more time to try it out?
Yeah. In my particular narrow field of expertise -- which, broadly speaking, is a subset of mechanical engineering -- I can say for a certainty that it's nowhere near PhD-level, and it's not perceptively smarter than o3-pro. Maybe it's slightly smarter, but honestly it's hard to tell.
I can confirm in head-to-head tests that Kimi is a far better prose stylist. I asked both models to write me a poem in the style of Ezra Pound's Canto I. Kimi's one-shot result was excellent; an "A+" effort at any school in the world, and genuinely professional-poet-tier. (Rather frightening, that.) GPT-5-Pro's result was a disaster that was so bad it verged on parody, and to add insult to injury it sometimes plagiarized Pound's Canto I word-for-word.
I will say that GPT-5 seems a little bit more imaginative and inventive than previous models. It seems slightly better than all other models at formal logic, to the extent that it's a superhuman analytic philosopher. It's also better and faster at searching the web, and it's a little bit more circumspect than usual about the results it shares. (It doesn't blindly promote every product.)
Ultimately this seems like a very incremental upgrade, but it's an upgrade nonetheless.
Is there anything GPT-5 is better at than GPT-5 Pro?