Sure. The issue is that the concepts referenced in this kind of idea are already at a very high level of abstraction—deceptively so, maybe.
For example, consider the notion of “humans in control of their own worlds.” This is not a concept that’s easy to describe in terms of quarks, or in terms of pixels! It’s really complicated and abstract! In order to be able to detect the concept “humans are in control of a virtual world instantiated in this hardware,” the AI needs to have a very sophisticated model of the world that has learned a lot of human-like concepts, and can optimize for those concepts without “breaking” them by finding edge cases.
Once you’ve solved these problems, it seems to me that you might as well go the last step and make an AI that you can safely tell “do the right thing.” The problems you need to solve are very similar.
But because the problems are very similar, I’m not going to discourage you if this is easier to think about for you—if you can start with this dream and really drill down to the things we need to work on today, it’s going to be important stuff.
Sure. The issue is that the concepts referenced in this kind of idea are already at a very high level of abstraction—deceptively so, maybe.
For example, consider the notion of “humans in control of their own worlds.” This is not a concept that’s easy to describe in terms of quarks, or in terms of pixels! It’s really complicated and abstract! In order to be able to detect the concept “humans are in control of a virtual world instantiated in this hardware,” the AI needs to have a very sophisticated model of the world that has learned a lot of human-like concepts, and can optimize for those concepts without “breaking” them by finding edge cases.
Once you’ve solved these problems, it seems to me that you might as well go the last step and make an AI that you can safely tell “do the right thing.” The problems you need to solve are very similar.
But because the problems are very similar, I’m not going to discourage you if this is easier to think about for you—if you can start with this dream and really drill down to the things we need to work on today, it’s going to be important stuff.