Skip to content

Comment on Google penalizes original content site because of scrapersparent

Comments

What I was thinking is if you have a list of scrapers supplied and a publish notification, Google could then index the alleged scraper sites directly (instead of waiting for a general index to find them), and then at some interval later. For true scraper, this should result in no match followed by match. Then Google can establish order of publishing, assuming Googles push-notification-to-index time is shorter than the scraper-polling-interval. And it seems people often know of their regular scrapers.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.