Tales - a block tolerant web scraper that runs on top of aws and rackspacegithub.com/calufa 3 pointscalufa13 years ago4 commentsSaveHideCopy link On HNComments−rachelbythebay13y>> Tales is design to scrape the web continuously, even when the domain being scraped blocks the scraper server ip; it goes around this problem by fail-overing to a new node (server).And people wonder why the AWS machines get filtered.−calufaOP13ythis is why jcoulds will be supported soon.−rachelbythebay13yAnd people will wonder why the jclouds machines get filtered.It's not the "where". It's the "what".−calufaOP13yI am just enabling. For me it's not the "what". Its the "who".
Comments
>> Tales is design to scrape the web continuously, even when the domain being scraped blocks the scraper server ip; it goes around this problem by fail-overing to a new node (server).
And people wonder why the AWS machines get filtered.
this is why jcoulds will be supported soon.
And people will wonder why the jclouds machines get filtered.
It's not the "where". It's the "what".
I am just enabling. For me it's not the "what". Its the "who".