Skip to content

Comment on At what point is the internet too big for Google to index it?

Comments

The problem isn’t that the internet is too big. It’s that Google and the internet grew apart from each other.

Some old sites never upgraded to https or other technical demands Google made of them. Google chose to stop indexing these sites to force them to change their behavior.

Most new content is trapped in walled gardens of some format. The one I see all the time is Discord, but the communities you care about are probably talking in a non-indexable group chat rather than an indexable Internet forum like they might have 20 years ago.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.