Just want to record that I agree with this with moderate confidence. Or more precisely: I think we’ll probably be able to make extremely good math-solving AIs with architecture that would be generally incompetent at most real world tasks, as (for instance) AlphaGoZero is thus incompetent.
I think “A narrow skill that in humans seems to require a whole lot of general intelligence, turns out to be able to be easily unbundled (or to be unbundled by default) from many of the other aspects of general intelligence” has a pretty good track record. Part of why I’m not super doomy, really.
Just want to record that I agree with this with moderate confidence. Or more precisely: I think we’ll probably be able to make extremely good math-solving AIs with architecture that would be generally incompetent at most real world tasks, as (for instance) AlphaGoZero is thus incompetent.
I think “A narrow skill that in humans seems to require a whole lot of general intelligence, turns out to be able to be easily unbundled (or to be unbundled by default) from many of the other aspects of general intelligence” has a pretty good track record. Part of why I’m not super doomy, really.