We can’t. And even an AI with no terminal values in other branches will still want to control them in order to increase utility in the branch it does through various indirect means, such as conterfactual trade, if that’s cheap, which it will be in any setup a human can think of.
We can’t. And even an AI with no terminal values in other branches will still want to control them in order to increase utility in the branch it does through various indirect means, such as conterfactual trade, if that’s cheap, which it will be in any setup a human can think of.