Comment on Improved ways to operate a rude crawlerComments−jsheard1yDon't forget to set "Accept-Encoding" to "identity", you wouldn't want to waste valuable CPU cycles on decompression. You need those for training!
Comments
Don't forget to set "Accept-Encoding" to "identity", you wouldn't want to waste valuable CPU cycles on decompression. You need those for training!