My intuition is that the really high expected utility of a positive FOOM and the really low expected utility of a bad one make Friendliness important if it gets even a fairly low probability. But it’s true that if all the AIs developed within, say 5 years of the first one get a substantial influence then the situation changes.
My intuition is that the really high expected utility of a positive FOOM and the really low expected utility of a bad one make Friendliness important if it gets even a fairly low probability. But it’s true that if all the AIs developed within, say 5 years of the first one get a substantial influence then the situation changes.