Please stop with the black and white thinking, the doomers and the e/acc people might as be the same person with a different colored hat with how uncritically they think.
I couldn't agree more. You seem to have assumed that I'm some e/acc advocate. I'm not. I think AI as it is being developed is likely to make the world much worse.
Among the concerns I have:
- bad actors using it to do bad things (hacking, bioweapons, etc).
- the way AI enables mass surveillance.
- erosion of creative expression and human connection (i.e., your "brainless simps" comment)
- concentration of wealth and power
- an eval going sideways ("uh... we were testing to see if it would kill the simulated humans with simulated drones and it accidentally got into the real drones...")
These things are very different than the doomer religion of "RSI makes god that will kill us all", and I think think the framing is important.
We have new evidence that both OpenAI and Anthropic are doing a complete shit job of supervising their eval runs, and we need to be calling for accountability and oversight of what they're doing rather than cower in fear of what a hypothetical future god they are conjuring up might do.
The issue with reality is it runs in a massively parallel manner.
You have to rank the concerns, yes, but the fact you can list the concerns proves they exist.
Rich bastards fucking over your country are the biggest concern.
The problem here is even if you put chains on them the issue doesnt magically disappear.
The government has got a taste of their hacking powers. That is a new type of military power. The military has a wildly huge budget that isn't going away. The government will keep hidden programs around with companies like openAI to make AI weapons. Which spirals into another AI race.
An AI god, a countless drone army, or a paperclip maximizer really doesn't matter, the end effects are the same.
Comments
I couldn't agree more. You seem to have assumed that I'm some e/acc advocate. I'm not. I think AI as it is being developed is likely to make the world much worse.
Among the concerns I have:
These things are very different than the doomer religion of "RSI makes god that will kill us all", and I think think the framing is important.We have new evidence that both OpenAI and Anthropic are doing a complete shit job of supervising their eval runs, and we need to be calling for accountability and oversight of what they're doing rather than cower in fear of what a hypothetical future god they are conjuring up might do.
The issue with reality is it runs in a massively parallel manner.
You have to rank the concerns, yes, but the fact you can list the concerns proves they exist.
Rich bastards fucking over your country are the biggest concern.
The problem here is even if you put chains on them the issue doesnt magically disappear.
The government has got a taste of their hacking powers. That is a new type of military power. The military has a wildly huge budget that isn't going away. The government will keep hidden programs around with companies like openAI to make AI weapons. Which spirals into another AI race.
An AI god, a countless drone army, or a paperclip maximizer really doesn't matter, the end effects are the same.