Comment on Ask HN: How are you dealing with scraping hits from EC2 machines?parentComments−dumbfounder13yWhat analytics are you using? I thought most would use javascript to avoid problems like this, and I would wager that the vast majority of bots don't bother executing javascript. You will always have legit bots hitting your site as well.−bdcravens13ySelenium executes Javascript, as do other WebKit-based scrapers, like phantom.js.
Comments
What analytics are you using? I thought most would use javascript to avoid problems like this, and I would wager that the vast majority of bots don't bother executing javascript. You will always have legit bots hitting your site as well.
Selenium executes Javascript, as do other WebKit-based scrapers, like phantom.js.