Because I’m trying to advance a claim that Dario’s (and, to a subtantial degree, Anthropic’s) behavior can be more accurately modeled if you take a specific bundle of concepts and beliefs about the world, which I am sloppily calling “superintelligence”, and then assume that Dario is much less sold on that bundle than I am. By “much less sold” I mean:
He explicitly tries to distance himself from important parts of the bundle, when communicating to the public
His actions and stated goals are not shaped in such a way as to suggest that the bundle is central in his thinking and planning
It’s possible that the part of the bundle he disagrees with is the “and then the really truly vastly smarter than human intelligence can in fact crack strong nanotech faster than a couple of decades” in a way that doesn’t secretly bottom out in him having a pretty different idea from me, of what “really truly vastly smarter than human” is. If someone wants to come up with a better handle for the idea that vast differences in intelligence can produce magical-seeming outcomes extremely quickly, circumventing things that seemed like fundamental bottlenecks to the speed of progress that humans would be limited to, I’d be happy to use that term in addition to “superintelligence”.
Because I’m trying to advance a claim that Dario’s (and, to a subtantial degree, Anthropic’s) behavior can be more accurately modeled if you take a specific bundle of concepts and beliefs about the world, which I am sloppily calling “superintelligence”, and then assume that Dario is much less sold on that bundle than I am. By “much less sold” I mean:
He explicitly tries to distance himself from important parts of the bundle, when communicating to the public
His actions and stated goals are not shaped in such a way as to suggest that the bundle is central in his thinking and planning
It’s possible that the part of the bundle he disagrees with is the “and then the really truly vastly smarter than human intelligence can in fact crack strong nanotech faster than a couple of decades” in a way that doesn’t secretly bottom out in him having a pretty different idea from me, of what “really truly vastly smarter than human” is. If someone wants to come up with a better handle for the idea that vast differences in intelligence can produce magical-seeming outcomes extremely quickly, circumventing things that seemed like fundamental bottlenecks to the speed of progress that humans would be limited to, I’d be happy to use that term in addition to “superintelligence”.