This is a fixable problem. BIP 0037[0] for example tries to mitigate the size issue with bloom filters, so you no longer need to download the complete block chain to be able to verify transactions.

[0]: https://en.bitcoin.it/wiki/BIP_0037