Comment on Who does Anubis actually stop?parentComments−eqvinox1moIt's impossible to know without trying, but I suspect those checks would be too easy to bypass/fake in a crawler.You can submit a PR and then we can try…−cedws1moMost scrapers are unsophisticated, this is why Anubis "works." For this same reason, basic fingerprinting already employed by Cloudflare et al would have the same efficacy.
Comments
It's impossible to know without trying, but I suspect those checks would be too easy to bypass/fake in a crawler.
You can submit a PR and then we can try…
Most scrapers are unsophisticated, this is why Anubis "works." For this same reason, basic fingerprinting already employed by Cloudflare et al would have the same efficacy.