Comment on Indexing a billion pagesparentComments−KomoD2yOh, so the extension is not crawling the website you visit but crawls the open web in the background?Yeah, it gets batches of links from their API and crawls them
Comments
Yeah, it gets batches of links from their API and crawls them