The reason why I originally wanted to solve the normal computercontrol problem is that I wanted to create programs that could inventively bring new programs in to the system.
If you bring new programs into a system and you are not careful about the system and solve the normal computer control problem you will get a system that allows useless and malign programs to thrive and can be subverted by other actors.
If AI has some similar properties or is based on this, then development teams will be incentivised to be safe at least in some regards to be effective in the real world.
The reason why I originally wanted to solve the normal computer control problem is that I wanted to create programs that could inventively bring new programs in to the system.
If you bring new programs into a system and you are not careful about the system and solve the normal computer control problem you will get a system that allows useless and malign programs to thrive and can be subverted by other actors.
If AI has some similar properties or is based on this, then development teams will be incentivised to be safe at least in some regards to be effective in the real world.