Skip to content

Comment on LLMs and self-referentialityparent

Comments

I'm asking on what basis you claim it to be categorically impossible.

Because the neural correlates of consciousness wouldn't exist in their brain. I've even looked into what happens if someone, blind from birth, takes LSD. There aren't any large scale studies as it's very difficult to get approval for them, but the short answer appears to be that they don't see things: https://www.livescience.com/62343-psychedelics-lsd-effects-b...

How is a multimodal LLM taking in RGB data fundamentally different than what your eyes are doing?

The multimodal LLM is a program run as a process on a computer, which isn't aware of what it's running: it's just blindly, repeatedly, executing whatever instruction is at its program counter. The LLM itself isn't doing anything. It's just sitting somewhere in memory being executed by the computer. Brains, on the other hand, don't run programs. Each part of the brain has a special purpose, and somewhere in it there are neurons which correlate with what is being experienced whenever something is looked at.

Because the neural correlates of consciousness wouldn't exist in their brain.

And what are those in concrete terms? Why can't a computer program have those? You have yet to articulate what special property is giving rise to this.

somewhere in it there are neurons which correlate with what is being experienced whenever something is looked at.

And what exactly is special about the neuron that the biological hardware can do this but the inorganic can't? Is your claim that current silicon doesn't do this (but future might be able to) or that no silicon construction could _ever_ do this?

You have yet to clearly articulate what this magical pixie dust of consciousness is supposed to be.

Why can't a computer program have those?

Because it isn't a physical object capable of sensing the physical environment, the way the brain is via the sense organs. I don't rule out the possibility that a robot, equipped with with a camera and microphone and processing the information it receives from them might be conscious of sight and sound, but not a program. If I read and execute a computer program in my head, I'm conscious of my thoughts while doing that, but are those thoughts themselves conscious?? I don't think so. What would they be conscious of, anyway?

You have yet to clearly articulate what this magical pixie dust of consciousness is supposed to be.

Nobody has an explanation of consciousness, so the magical pixie dust remains a mystery. I think it's fundamental. Nobody has proven the opposite: that it arises from things (e.g. information processing) happening in matter.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.