Comment on Kogan.com mysteriously disappears from Microsoft Search EnginesparentComments−X-Istence14yWhy would you want to serve up a robot.txt as "text/html" when in reality it is "text/plain"?
Comments
Why would you want to serve up a robot.txt as "text/html" when in reality it is "text/plain"?