Ask HN: Have you noticed decreased quality in GPT-4 reasoning recently?
I noticed a significant decrease in the model reasoning abilities in the last few days, especially when it comes to writing code. Has anyone else experienced this?
Given that these models are being used in all sorts of applications all over the world, I think it's concerning that OpenAI can lobotomize a model in secret and no one can verify that and do something about it.
Comments
As an EU user, I feel like it has been watered down a lot, both 3.5 and 4. Many queries now come with disclaimers which are pretty annoying since you can't set your own system instructions in the ChatGPT interface. Using the API is fine though since you can explicitly say that you want a specific format.
true they could be fiddling w things as the EU AI Act moves forward
Wouldn't surprise me if members of EU parliament and comission were big time customers now via the OpenAI playground.
The more they force the model into politically-fashionable responses, the further they get away from rational thought process. CodeT5+ looks promising though
...And in fact some at Google are already projecting a future of Open Source dominance in the subfield.
(Edit: the system must have missed a post update: )
...Coincidentally, in fact, a neighbouring post is: OpenAI readies new open-source AI model - https://news.ycombinator.com/item?id=35958789