halis on Ask HN: How are you dealing with scraping hits from EC2 machines? · Hackerly

Comment on Ask HN: How are you dealing with scraping hits from EC2 machines?parent

Someone scraping your site may not respect robots.txt