it'll be the singularity, superintelligence will be optimizing human affairs and launching probes to other stars as it disassembles the solar system for material to build a Dyson swarm, and people will still claim it's not "really" intelligent.
That sounds interesting, could you please expand on that? Do you have in mind any particular facet of general intelligence that a milestone cannot be defined for?
Ah apologies for having been unclear. No, not like that - I was thinking about more meta aspects of it:
- shared context (shared biological & cultural heritage)
- recognition & willingness to ascribe intelligence
Basically trying to imply that the general AI problem is of similar nature to the 10x programmer problem - communication & recognition, or lack of thereof.
A 10x programmer makes a hard problem look easy. A general AI makes people around it feel very smart & productive.
Which is also why I prefaced it with, The terrain is not the map - we humans know surprisingly little about our intelligence.
Comments
In AI research, the territory is not the map.
A half-joking prediction:
at some point we'll solve all arbitrarily hard milestones for AIs and will still find ourselves 'nowhere near having real general intelligence'.
At that point we might start questioning our assumptions about intelligence.
A fully serious prediction:
it'll be the singularity, superintelligence will be optimizing human affairs and launching probes to other stars as it disassembles the solar system for material to build a Dyson swarm, and people will still claim it's not "really" intelligent.
That sounds interesting, could you please expand on that? Do you have in mind any particular facet of general intelligence that a milestone cannot be defined for?
Ah apologies for having been unclear. No, not like that - I was thinking about more meta aspects of it:
- shared context (shared biological & cultural heritage)
- recognition & willingness to ascribe intelligence
Basically trying to imply that the general AI problem is of similar nature to the 10x programmer problem - communication & recognition, or lack of thereof.
A 10x programmer makes a hard problem look easy. A general AI makes people around it feel very smart & productive.
Which is also why I prefaced it with, The terrain is not the map - we humans know surprisingly little about our intelligence.
[edit]
Case in point, an older discussion about intelligence in animals: https://news.ycombinator.com/item?id=21772648