The problem arises when it isn’t doing that. Say you tell the superintelligence to sit still and do nothing. It’s a meditating superintelligence—but you can’t easily determine that until after it has stopped meditating.
The problem arises when it isn’t doing that. Say you tell the superintelligence to sit still and do nothing. It’s a meditating superintelligence—but you can’t easily determine that until after it has stopped meditating.