Comment on Anthropic is scraping websites so fast it's causing problemsComments−jakubsuchy2yJust like Cloudflare many providers now just allow blocking: https://www.haproxy.com/blog/how-to-reliably-block-ai-crawle...(disclaimer: I wrote this blog post)
Comments
Just like Cloudflare many providers now just allow blocking: https://www.haproxy.com/blog/how-to-reliably-block-ai-crawle...
(disclaimer: I wrote this blog post)