Comment on Indexing a billion pagesparentComments−Alifatisk2yOh, so the extension is not crawling the website you visit but crawls the open web in the background?How much cpu / ram does it consume?−KomoD2yOh, so the extension is not crawling the website you visit but crawls the open web in the background?Yeah, it gets batches of links from their API and crawls them
Comments
Oh, so the extension is not crawling the website you visit but crawls the open web in the background?
How much cpu / ram does it consume?
Yeah, it gets batches of links from their API and crawls them