Comment on Classifying all of the pdfs on the internetparentComments−fsckboy2yRTBF does not ban crawling or caching. It bans opening up those archives to the public via search engines.−gsck2yIt bans having them in the first place. Not just looking at them.
Comments
RTBF does not ban crawling or caching. It bans opening up those archives to the public via search engines.
It bans having them in the first place. Not just looking at them.