Comment on Cloudflare turns AI against itself with endless maze of irrelevant factsparentComments−theragra1yLawless or lawful? I don't understand why people hate crawlers that much. I understand arguments about ones that violate robots.txt, but not correct ones.
Comments
Lawless or lawful? I don't understand why people hate crawlers that much. I understand arguments about ones that violate robots.txt, but not correct ones.