Comment on Robots.txt for the NYT has a specific exclusion for an 1996 news articleparentComments−worldofmatthew5yGoogle often delists articles over around 15 to 20 years after they are put on the internet.
Comments
Google often delists articles over around 15 to 20 years after they are put on the internet.