Comment on Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answersparentComments−amelius1moThen the least they can do is cite ALL their sources. At least somewhere on their website.−brookst1moSo an HTML page with a list of essentially every page on every site on the internet? What do you think, maybe a trillion URLs?−amelius1moYes. Whatever makes their lawyers nervous.
Comments
Then the least they can do is cite ALL their sources. At least somewhere on their website.
So an HTML page with a list of essentially every page on every site on the internet? What do you think, maybe a trillion URLs?
Yes. Whatever makes their lawyers nervous.