Skip to content

Comment on Tell HN: Amazonbot aggressively scraping my website and ignoring robots.txtparent

Comments

Whether it’s negligent isn’t terribly relevant. Is it illegal? It is not, they aren’t bypassing access controls. No different than using Shodan, scanning public IPs, crawling open directories, etc.

It would be different if they were attempting to brute force credentials to access an endpoint, but they aren’t.

they aren’t bypassing access controls.

Weev went to jail for accessing public api's, https://en.wikipedia.org/wiki/Weev#AT&T_data_breach

The flaw was part of a publicly-accessible URL, which allowed the group to collect the e-mails without having to break into AT&T's system.

It was argued that he didn't circumvent, but it didn't stop them from putting him in jail initially.

His conviction was vacated and Amazon has deep pockets and diffusion of internal liability. The illicit state drug charges did not help his case.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.