Comment on Robots.txt for the NYT has a specific exclusion for an 1996 news articleparentComments−rurban5yYou wont find anything, as it was taken down a few days after publication. The NY Times article was taken down later, but had not much juicy info.
Comments
You wont find anything, as it was taken down a few days after publication. The NY Times article was taken down later, but had not much juicy info.