It is not that "Instant responsiveness in user interfaces is annoying". It is that certain features should not have Instant responsiveness, while other features should.

Generally speaking I want instant response especially on native apps, but I agree with all the examples you gave especially when it has something to do with Internet. I actually want consistent rendering time across the site rather than fastest possible page view every time.