I think one reason why a lot of people are hesitant to charge money is that it completely alters the relationship with your users. Paying customers deserve a much higher level of service than free users.

This is probably just another good reason to charge though. Taking other people's money is a commitment to providing service to them in exchange. You can't have too many good reasons not to give up.