Skip to content

Comment on Lessons learned building a web application crawler

Comments

ukd1OP

One of our engineers built a web-app crawler from scratch (why? enable users to quickly build a QA test plan). Jiri researched existing crawlers first and found nothing: he wrote about why build from scratch, plus technical challenges he ran into.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.