Sure, it isn't ethical to experiment w/o consent. But in order to program an AGI, you need first to conjecture an explanation of how the mind works. One may be able to deduce from that explanation some of the ways in which minds can go wrong. Also, assuming consent is given, it will likely be easier (and less physically invasive) to observe the internal state of an artificial person.
Comments
Is it ethical to experiment on artificial people? Wouldn't the artificial person describe itself as experiencing consciousness?
Sure, it isn't ethical to experiment w/o consent. But in order to program an AGI, you need first to conjecture an explanation of how the mind works. One may be able to deduce from that explanation some of the ways in which minds can go wrong. Also, assuming consent is given, it will likely be easier (and less physically invasive) to observe the internal state of an artificial person.