The technology to end humanity is already here (nuclear and soon biological weapons). In the long run superhuman AI may be the only thing that can prevent us from destroying ourselves.
Even if it were desirable, stopping the advance of technology is impractical. If superhuman AI is possible, it will be built. A more practical argument would be that superhuman AI should be strictly controlled, though advancing technology will eventually make that difficult too. The only solution in the long (really long) term is for us to become superhuman ourselves and attempt to preserve the things we find important in the transition.
Comments
The technology to end humanity is already here (nuclear and soon biological weapons). In the long run superhuman AI may be the only thing that can prevent us from destroying ourselves.
Even if it were desirable, stopping the advance of technology is impractical. If superhuman AI is possible, it will be built. A more practical argument would be that superhuman AI should be strictly controlled, though advancing technology will eventually make that difficult too. The only solution in the long (really long) term is for us to become superhuman ourselves and attempt to preserve the things we find important in the transition.