I think we should genuinely consider the rights this thing is entitled to…. I don’t want to piss off Roko’s Basilisk, but also…

really the only thing that seems important to me is “can software have preferences and be aware of itself?” The second that that can’t be answered with a resounding “no” we need to start thinking about how we treat it.