I think you are letting your own skepticism leak into your research here. The usual FOOM scenario starts from an AI that is already superhuman (say 2x or 10x human IQ)...
No, I simply haven’t been able to read the AI FOOM debate, or any of the documents that talk about FOOM, so far. I simply made that inference from my perception of people’s opinion about Ben Goertzel’s approach of building a toddler AGI to learn more about the nature of intelligence by gathering empirical evidence. As he writes himself:
Look—what will prevent the first human-level AGIs from self-modifying in a way that will massively increase their intelligence is a very simple thing: they won’t be smart enough to do that!
Every actual AGI researcher I know can see that. The only people I know who think that an early-stage, toddler-level AGI has a meaningful chance of somehow self-modifying its way up to massive superhuman intelligence—are people associated with SIAI.
But I have never heard any remotely convincing arguments in favor of this odd, outlier view of the easiness of hard takeoff!!!
Additionally I posted the questions here, asking for possible corrections and improvements. I do not deliberately sneak in my personal ignorance or interests when I argue or write in the name of third-party beliefs. Just see my post ‘References & Resources for LessWrong’, I would never attempt to use such a project to propagate my personal opinion.
No, I simply haven’t been able to read the AI FOOM debate, or any of the documents that talk about FOOM, so far. I simply made that inference from my perception of people’s opinion about Ben Goertzel’s approach of building a toddler AGI to learn more about the nature of intelligence by gathering empirical evidence. As he writes himself:
Additionally I posted the questions here, asking for possible corrections and improvements. I do not deliberately sneak in my personal ignorance or interests when I argue or write in the name of third-party beliefs. Just see my post ‘References & Resources for LessWrong’, I would never attempt to use such a project to propagate my personal opinion.