Bot web traffic has overtaken human web traffic, data showsnbcnews.com 11 pointspsychanarch3 months ago3 commentsSaveHideCopy link On HNComments−mmarian3moHe's promoting pay per crawl again. Wrote a blog post last year on why I don't see it working https://developerwithacat.com/blog/202507/cloudflare-pay-per...−jnakano893mo"Make the web free for humans by charging bots" is a great pitch when you're the one positioned to be the toll booth.−eqvinox3moCounterargument is immediately above that quote: bots don't click on ads.Also, you're free to build your own worldwide CDN. CloudFlare might be the largest but Akamai, CloudFront, Fastly, etc. exist.
Comments
He's promoting pay per crawl again. Wrote a blog post last year on why I don't see it working https://developerwithacat.com/blog/202507/cloudflare-pay-per...
"Make the web free for humans by charging bots" is a great pitch when you're the one positioned to be the toll booth.
Counterargument is immediately above that quote: bots don't click on ads.
Also, you're free to build your own worldwide CDN. CloudFlare might be the largest but Akamai, CloudFront, Fastly, etc. exist.