Comment on Messing with scraper botsparentComments−renegat0x09moEven I, who does not know much, implemented a workaround.I have a web crawler and I have both scraping byte limit and timeout, so zip bombs dont bother me much.https://github.com/rumca-js/crawler-buddyI think garbage blabber would be more effective.
Comments
Even I, who does not know much, implemented a workaround.
I have a web crawler and I have both scraping byte limit and timeout, so zip bombs dont bother me much.
https://github.com/rumca-js/crawler-buddy
I think garbage blabber would be more effective.