I used to accept when I was potentially interested in getting new job :-) I even got quite an interesting interview from my LinkedIn network long time ago. Now recruiters contact me for slightly different purposes and mostly it's a waste of time from my perspective.

Some of them will try to connect with you if you have many connections so then they harvest your connections too - I deal with it by making sure nobody can see my connections (you can set this up in privacy section)