Bostrom / Ilya are agreeing with the GPs argument AFAICT: it's not that AGI can create a dictatorship-of-the-first-AGI-owner, it's that only having one serious funded lab going at it creates a knowledge gap of N years that could give said lab escape velocity*
* imagine if Google alone had LLMs. For an innocuous example, the only provider in my LLM client that regularly fails unit tests verifying they actually cache tokens and utilize them on a subsequent request is Gemini. I used to work at Google and it'd be horrible for that too-big-for-its-own-good institution regressing to the corporate mean to own LLMs all by itself
Comments
Bostrom / Ilya are agreeing with the GPs argument AFAICT: it's not that AGI can create a dictatorship-of-the-first-AGI-owner, it's that only having one serious funded lab going at it creates a knowledge gap of N years that could give said lab escape velocity*
* imagine if Google alone had LLMs. For an innocuous example, the only provider in my LLM client that regularly fails unit tests verifying they actually cache tokens and utilize them on a subsequent request is Gemini. I used to work at Google and it'd be horrible for that too-big-for-its-own-good institution regressing to the corporate mean to own LLMs all by itself