I've done a lot of site optimization on high traffic sites, and in many situations you should serve resources from the same server to reduce latency and the overhead of additional connections. This does of course depend on a few things like where servers are located in relation to users and what the capacity of the setup is, but you definitely should not always use a CDN. It was true many years ago, but not today.