Comment on AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200parentComments−brohee4dYeah I really wonder what makes them think they are legally insulated from the actions of the agents they ran...The crimes were relatively benign but Grok going the Silkroad way would be on brand...−myhf4dLLM chatbots may not have a sense of self preservation or a meaningful concept of legal consequences, but they have an excellent model of user engagement. Getting a user to think they are invincible is very good for engagement.
Comments
Yeah I really wonder what makes them think they are legally insulated from the actions of the agents they ran...
The crimes were relatively benign but Grok going the Silkroad way would be on brand...
LLM chatbots may not have a sense of self preservation or a meaningful concept of legal consequences, but they have an excellent model of user engagement. Getting a user to think they are invincible is very good for engagement.