So we have several datacentres around the world, and when users input a link. A server will take the task and try to download the content on the web, based on trial & error and user's response it learns how to download from a particular website.

So.. a proxy?