Drift Into Failure is a good read about how systems fail, albeit a little light on solutions.