Comment on Ask HN: How are you dealing with scraping hits from EC2 machines?parentComments−brechin13ySo, would that detection mechanism be able to deal with a number of coordinated scrapers rotating through lists of proxies, using different User-Agent strings, making requests with (pseudo-)random delays between requests?−seats13yyup, read the paper
Comments
So, would that detection mechanism be able to deal with a number of coordinated scrapers rotating through lists of proxies, using different User-Agent strings, making requests with (pseudo-)random delays between requests?
yup, read the paper