Comment on Facebook owner Meta to remove news from platform if Congress passes media billparentComments−mccorrinall3yIf they don’t want to be spidered maybe just use robots.txtThey can’t have both: exposure AND content only available on their platform−chownie3yCan you expand on that? Should Google have rights to use any of your content if you allow spidering? Including for commercial gain?−mccorrinall3yYes and yes. It’s okay to crawl a site and show the meta tags like short description, title, author etc. Why should it be illegal?
Comments
If they don’t want to be spidered maybe just use robots.txt
They can’t have both: exposure AND content only available on their platform
Can you expand on that? Should Google have rights to use any of your content if you allow spidering? Including for commercial gain?
Yes and yes. It’s okay to crawl a site and show the meta tags like short description, title, author etc. Why should it be illegal?