Its really the lottery system for the public schools that is the reason most of my friends with kids left SF. People buy houses in certain neighborhoods to guarantee which school their kids attend. Without that guarantee, there is not much incentive to live there.