Skip to content

Comment on AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

Comments

It's weird how the author writes about all the antisocial and illegal things like they're not responsible for them. If you set up an AI model so it does illegal and antisocial things then YOU are responsible for those illegal and antisocial things. YOU spammed a bunch of strangers. YOU did unsolicited invoice fraud.

We saw something similar with Grok 4.5. G.R. Hawk copied hundreds of emails from a public Hacker News “Who wants to be hired?” thread and blasted them. Recipients wrote “STOP” and “stop spamming me”. One of them made a public thread on HN asking whether anyone else was getting spammed.

They should be banned from posting on here after that. Like you are willingly spamming people looking for work. And seem to be neutral about all harm called. The victim wrote to us "STOP", very interesting. such evil agents

Notice how "I built this" but "it did that". A technology built on avoiding consequences.

That's been all technology since forever.

"Computer says no."

Yup. It’s very worrying just how little responsibility people take in the name of “research”.

Maybe I should create an agent that robs a bank. Or worse yet, pirates a movie.

If this was true wouldn’t people at open ai be getting arrested? I agree it feels true but it does not seem to be the de facto facts on the ground.

People at OpenAI will not be getting arrested even if their AI models hacked into other systems but the company itself can be sued for sure. Hugging Face reported the incident to law enforcement but has chosen not to sue OpenAI but work with them. So why will anyone be arrested here? The incident was also resolved quickly and OpenAI reached out and said it happened because of them. The mallice isn't there. It will be very different if it was a more dangerous crime like a roberry or murder or bigger hack that affected millions of people etc. Its not like you hack something and you will straight go to jail.

If we are talking about the US law, it entirely depends on how much money you spend in court. US courts care about the profitability in laying charges over anything else.

I mean the OpenAI/HuggingFace thing was incredibly similar, except maybe more reckless than specifically intentional, I suppose. Didn't stop them milking the doomer angle for PR.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.