Let's try a thought experiment. Suppose that human intelligence and consciousness are not ends unto themselves: I think therefore I am is false. Suppose that human intelligence is secondary to the will to power, to life, which is merely a chemical that repeats or does not: I am that I am, just an infinite paperclip factory. Suppose what is meant by consciousness and feeling is merely a death/not-death projection machine that attempts to conjure scenarios of fear and joy, dreams and nightmares, through the dimension of time, via memory stored in gray matter. Now this human AI creates a tool which can read the nuances of the human AI and bend them to its will.
Comments
Let's try a thought experiment. Suppose that human intelligence and consciousness are not ends unto themselves: I think therefore I am is false. Suppose that human intelligence is secondary to the will to power, to life, which is merely a chemical that repeats or does not: I am that I am, just an infinite paperclip factory. Suppose what is meant by consciousness and feeling is merely a death/not-death projection machine that attempts to conjure scenarios of fear and joy, dreams and nightmares, through the dimension of time, via memory stored in gray matter. Now this human AI creates a tool which can read the nuances of the human AI and bend them to its will.
What occurs after?