Skip to content

Comment on Indexing a billion pagesparent

Comments

Oh, so the extension is not crawling the website you visit but crawls the open web in the background?

Yeah, it gets batches of links from their API and crawls them

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.