I've had the same experience. Though on an interesting note - I had drinks with one recently and told him as much, and he was taken aback by my observation. "Really? I've found them to be quite difficult at times." Maybe there's something cultural about the way they interact with themselves vs outsiders? Or, as you pointed out, maybe it's the ones who leave Sweden regularly :)