Comment on Robots.txt for the NYT has a specific exclusion for an 1996 news articleComments−throwbigdata5yhttps://en.m.wikipedia.org/wiki/Apophasis
Comments
https://en.m.wikipedia.org/wiki/Apophasis