Skip to content

Comment on Tales - a block tolerant web scraper that runs on top of aws and rackspace

Comments

>> Tales is design to scrape the web continuously, even when the domain being scraped blocks the scraper server ip; it goes around this problem by fail-overing to a new node (server).

And people wonder why the AWS machines get filtered.

this is why jcoulds will be supported soon.

And people will wonder why the jclouds machines get filtered.

It's not the "where". It's the "what".

I am just enabling. For me it's not the "what". Its the "who".

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.