Comment on Ask YC: How to web scrape 100s of sites/forms?Comments−Anon8418yCheck out the search.wikia.org project. They make their crawler (and crawl data) available. Maybe you can get away with using theirs. That would really be cheap!
Comments
Check out the search.wikia.org project. They make their crawler (and crawl data) available. Maybe you can get away with using theirs. That would really be cheap!