We're being forced to use some AI features in our IDE at work these days, and we see it make stuff up all the time. Very unpleasant to work with. It will tell us implementing something a certain way is impossible, when I've implemented it myself that way in the past. It will fabricate reasons why builds are failing. It will make assumptions about database schemas from thin air.
It's like a science fiction writer or an improv actor doing technobabble. If by chance it knows the actual answer it might use it, but even if not it still has to say _something_ that sounds plausible to a layperson. It'll never say it doesn't actually know, because their character it's acting as _should_ know.
Comments
We're being forced to use some AI features in our IDE at work these days, and we see it make stuff up all the time. Very unpleasant to work with. It will tell us implementing something a certain way is impossible, when I've implemented it myself that way in the past. It will fabricate reasons why builds are failing. It will make assumptions about database schemas from thin air.
It's like a science fiction writer or an improv actor doing technobabble. If by chance it knows the actual answer it might use it, but even if not it still has to say _something_ that sounds plausible to a layperson. It'll never say it doesn't actually know, because their character it's acting as _should_ know.