Amount of traffic is what matters. Are you saturating your pipe 24/7 for an entire month? Sure, you may have problems. But you'd have the same problems if you were torrenting (let's assume legal torrents here, I am not talking about copyright) or hosting a mega LAN party with hundreds of people streaming their games all at once.

Otherwise, no worries.