The question is how difficult it is to jump from the stupid AI to the general AI. Does it require hundred gradual improvements? Or could just one right improvement in the right situation jump across the whole abyss? Something like taking the “idiot savant golem with severe autism” who cares only about one specific goal, and replacing the goal with “understand everything, and apply this understanding to improving your own functionality”… and suddenly we have the fully general AI.
Remember that compartmentalization exists in human minds, but the world is governed by universal laws. In some sense, “understanding particles” is all you need. And of course some techniques to overcome computational costs, such as creating and using higher-level models. -- With the higher-level models, compartmentalization can return, but maybe it would be different for a mind that could work not just within these models, but also to create and modify them as necessary, as opposed to the human mind, which has some of those levels hardwired and the other ones always feel a bit “strange”.
Being good at translating thousand languages is not scary. Being good at modelling thousand situations, probably yes.
The question is how difficult it is to jump from the stupid AI to the general AI. Does it require hundred gradual improvements? Or could just one right improvement in the right situation jump across the whole abyss? Something like taking the “idiot savant golem with severe autism” who cares only about one specific goal, and replacing the goal with “understand everything, and apply this understanding to improving your own functionality”… and suddenly we have the fully general AI.
Remember that compartmentalization exists in human minds, but the world is governed by universal laws. In some sense, “understanding particles” is all you need. And of course some techniques to overcome computational costs, such as creating and using higher-level models. -- With the higher-level models, compartmentalization can return, but maybe it would be different for a mind that could work not just within these models, but also to create and modify them as necessary, as opposed to the human mind, which has some of those levels hardwired and the other ones always feel a bit “strange”.
Being good at translating thousand languages is not scary. Being good at modelling thousand situations, probably yes.