I don't know, I find AI still misses the mark so much for stuff that's not happening inside a well constrained framework with very specific guardrails and boundary conditions. Every time I have agents build something half complex that I would be easily able to pull off myself (albeit not at their pace) I always ask if everything is correct and working and I get a resounding "yes!", then I test it and it's essentially a steaming pile of garbage which I then tell the agent and after which it goes "you're absolutely right to push back, this isn't good at all!" as if it was clear from the beginning. I don't know if we'll achieve real intelligence soon with these things but what we have now isn't there yet. It's incredibly useful but I don't think you can replace a good programmer with it, you can make a good programmer into an excellent one though!
Same goes for writing, anyone who has written long complex texts with LLMs knows that a ton of editing is required to make it half decent.
Even for my tiny toy projects, I notice a bug and I tell the LLM and it corrects it, most of the time, but I shudder at the amount of code it generates or changes.
If it has some subtle data corruption bug then you're hosed.
It's just crazy to me to think about running AI changes in production on a real product.
Comments
I don't know, I find AI still misses the mark so much for stuff that's not happening inside a well constrained framework with very specific guardrails and boundary conditions. Every time I have agents build something half complex that I would be easily able to pull off myself (albeit not at their pace) I always ask if everything is correct and working and I get a resounding "yes!", then I test it and it's essentially a steaming pile of garbage which I then tell the agent and after which it goes "you're absolutely right to push back, this isn't good at all!" as if it was clear from the beginning. I don't know if we'll achieve real intelligence soon with these things but what we have now isn't there yet. It's incredibly useful but I don't think you can replace a good programmer with it, you can make a good programmer into an excellent one though!
Same goes for writing, anyone who has written long complex texts with LLMs knows that a ton of editing is required to make it half decent.
Even for my tiny toy projects, I notice a bug and I tell the LLM and it corrects it, most of the time, but I shudder at the amount of code it generates or changes.
If it has some subtle data corruption bug then you're hosed.
It's just crazy to me to think about running AI changes in production on a real product.