I've been thinking more about my post above, and I've come to two conclusions:

1. Don't post late at night.

2. I have no idea how society could integrate with a sufficiently complicated synthetic intelligence. What would person-hood even mean to something that can be instantiated? Easier to not think about any of this.