Skip to content

Comment on Human study on AI spear phishing campaigns

Comments

They built their phishing emails using data scraped from public profiles. Fascinating.

I have to wonder if, in the near future, we're going to have a much higher perceived cost for online social media usage. Problems we're already seeing:

- AI turning clothed photos into the opposite [0]

- AI mimicking a person's voice, given enough reference material [1]

- Scammers impersonating software engineers in job interviews, after viewing their LinkedIn or GitHub profiles [2]

- Fraudsters using hacked GitHub accounts to trick other developers into downloading/cloning malicious arbitrary code [3]

- AI training on publicly-available text, photo, and video, to the surprise of content creators (but arguably fair use) [4]

- AI spamming github issues to try to claim bug bounties [5]

All of this probably sounds like a "well, duh" to some of the more privacy and security savvy here, but I still think it has created a notable shift from the tech-optimism that ran from 2012-2018 or so. These problems all existed then, too, but with less frequency. Now, it's a full-pressure firehose.

[0]: https://www.wsj.com/politics/policy/teen-deepfake-ai-nudes-b...

[1]: https://www.fcc.gov/consumers/guides/deep-fake-audio-and-vid...

[2]: https://connortumbleson.com/2022/09/19/someone-is-pretending...

[3]: https://it.ucsf.edu/aug-2023-impersonation-attacks-target-gi...

[4]: https://creativecommons.org/2023/02/17/fair-use-training-gen...

[5]: https://daniel.haxx.se/blog/2024/01/02/the-i-in-llm-stands-f...

It's all part of the grand enshittification. Trust in anything Internet is gonna erode without any auth, anonymous internet will slowly die.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.