Why give them access to your account at all?

I did this with Facebook eons ago and they just kept the data and it haunted me for years. No, I don't want to add people I removed from my address book years ago.