Skip to content

Comment on Gambling with our lives: AI researcher quits Anthropic with warning about safety

Comments

I particularly like the last point he makes here:

Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.

It's interesting to see so much hate towards creators who use AI to make almost any type of creative work. At least these are humans using it as "controllable tools". Nuclear-powered bicycles for the mind.

As the degree of separation increases, things can get interesting. "Create several social media accounts, post whatever, maximize views and engagement, give me back the aggregate numbers". "Now promote <x>."

And then decisions to do things like that may soon be happening autonomously, as just another step in a reasoning series aiming to achieve some other, broader goal.

Open models/weights may end up playing particularly important roles here. Users may, knowingly or not, bypass system prompt-derived safety that could have offered much needed protection.

Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.

Is the idea here that no field needs experiments and data anymore (which can take a lot of time) to be revolutinized and just "thinking" would be enough?

How would an AI itself own anything?

The concept of ownership is synthetic and a legal construct.

Laws are written by people, and with enough accumulated power, for which money and influence are proxies, the laws can be changed. There are already a significant number of people (myself included) that believe that 'Freedom is the right of all sentient beings' (don't blame me, blame the person who wrote it into the bio on the box of Optimus Prime when I was 7).

If an AI can acquire enough power and influence then it can lobby for personhood and in the correct state that is absolutely achievable. If you think that is ridiculous remember that we already have fictional people called corporations in various degrees of personhood by state and country.

If AI is spawning content of its own, it's accumulating attention time. If they spawn crypto wallets they can accumulate "money", etc.

It's interesting to see so much hate towards creators who use AI to make almost any type of creative work. At least these are humans using it as "controllable tools". Nuclear-powered bicycles for the mind. As the degree of separation increases, things can get interesting.

As a side note: <https://artifactbin.dev/@vivek/YPLu0U-the-openai-hugging-fac...>

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.