Website unresponsive: diagnostic steps and blocking the AI crawlersphysicsderivationgraph.blogspot.com 2 pointsphysicsgraph9 months ago2 commentsSaveHideCopy link On HNComments−cport18momight want to try something like https://webdecoy.com−Festro9moBlocking IP ranges is just whack-a-mole though right? Glad you got the site back up but this necessitates a high level of vigilance going forward.Can a softer throttling approach work? Rate limit the naughty IPs when they go over a threshold, or even increase rate limits as CPU/RAM usage climbs?
Comments
might want to try something like https://webdecoy.com
Blocking IP ranges is just whack-a-mole though right? Glad you got the site back up but this necessitates a high level of vigilance going forward.
Can a softer throttling approach work? Rate limit the naughty IPs when they go over a threshold, or even increase rate limits as CPU/RAM usage climbs?