Comment on Elevated errors on Claude Opus 5parentComments−simiones1moIt is a well known fact that projects with unit tests never have regressions.−cbg01moI don't understand the need for the snarky comment, LLMs can run the test suite and avoid regressions.−simiones1moA change can introduce regressions in any large project even if 100% of unit tests pass. Unit tests test individual units, regressions can happen at many levels. Especially if we treat performance degradations as regressions.
Comments
It is a well known fact that projects with unit tests never have regressions.
I don't understand the need for the snarky comment, LLMs can run the test suite and avoid regressions.
A change can introduce regressions in any large project even if 100% of unit tests pass. Unit tests test individual units, regressions can happen at many levels. Especially if we treat performance degradations as regressions.