Good post. Sounds like you have a good head on your shoulders and are doing the right things, so far as the theories are concerned. But as Einstein said "In theory, theory and practice are the same. In practice, they are not."

I'm in a similar situation. I would love to hear how people are tackling these problems in practice, and any success stories.