Comment on Robots.txt Disallow: 20 Years of Mistakes To AvoidparentComments−chdir12yUnfair to name & shame a private entity that doesn't want it's content to be archived.−hnha12yprivately owned but publicly acting!
Comments
Unfair to name & shame a private entity that doesn't want it's content to be archived.
privately owned but publicly acting!