I'm reading Iain McGhilchrist's The Master and his Emissary. There's a bit about right brain damage correlating (fact?) to lacking empathy.

    Patients with right frontal deficits, but not left frontal deficits, suffer a change of personality whereby they become incapable of empathy.