There's nothing that stops CoT becoming a godel numbering, for efficiency and for subterfuge.

All this chatter isn't going to solve the conceptual problems. Those problems exist regardless of whether it's consciousness or a advanced artificial rubegoldberg device that's just setting up automata that have zero intent and humans have zero predictive capabilities.

The idea that AGI and advanced AGI are given outcomes should be scrutinized the same way we understand cellular automata.