This interaction of computer and human decision-making is actually the subject of a fair bit of active research. e.g. at Duke http://hal.pratt.duke.edu/

To your basic point--yep, at some point you need to stop automating unless you're willing to hand over control entirely.