Is this 5 years of engineering effort and then humans leaving it alone with infinite compute?
Maybe something like ‘5 years of engineering effort to start automating work that qualitatively (but incredibly slowly and inefficiently) is helping with AI research, and then a few decades of throwing more compute at that for the AI to reach superintelligence’?
With infinite compute you could just recapitulate evolution, so I doubt Paul thinks there’s a crux like that? But there could be a crux that’s about whether GPT-3.5 plus a few decades of hardware progress achieves superintelligence, or about whether that’s approximately the fastest way to get to superintelligence, or something.
Maybe something like ‘5 years of engineering effort to start automating work that qualitatively (but incredibly slowly and inefficiently) is helping with AI research, and then a few decades of throwing more compute at that for the AI to reach superintelligence’?
With infinite compute you could just recapitulate evolution, so I doubt Paul thinks there’s a crux like that? But there could be a crux that’s about whether GPT-3.5 plus a few decades of hardware progress achieves superintelligence, or about whether that’s approximately the fastest way to get to superintelligence, or something.