I probe Claude on occasion when I don't feel like looking up source documentation. A couple weeks ago, I was interrogating it about a system that happened to use Kafka. Last night, I was asking it to propose an entirely different solution and it kept trying to shoe horn Kafka into it. I asked it why and proposed a simpler alternative. I was absolutely right! Claude was just very eager to demonstrate familiarity with other systems I was working on!

I shudder to think of the things people will wind up shipping blindly accepting AI guidance.