I give the probability that some authority figure would use an order-following AI to get torturous revenge on me (probably for being part of a group they dislike) is quite slim. Maybe one in a few thousand, with more extreme suffering being less likely by a few more orders of magnitude? The probablility that they have me killed for instrumental reasons, or otherwise waste the value of the future by my lights, is mich higher—ten percent-ish, depends on my distribution over who’s giving the orders. But this isn’t any worse to me than being killed by an AI that wants to replace me with molecular smiley faces.
To me, those odds each seem optimistic by a factor of about 1000, but ~reasonable relative to each other.
(I don’t see any low-cost way to find out why we disagree so strongly, though. Moving on, I guess.)
But this isn’t any worse to me than being killed [...]
Makes sense (given your low odds for bad outcomes).
Do you also care about minds that are not you, though? Do you expect most future minds/persons that are brought into existence to have nice lives, if (say) Donald “Grab Them By The Pussy” Trump became god-emperor (and was the one deciding what persons/minds get to exist)?
I give the probability that some authority figure would use an order-following AI to get torturous revenge on me (probably for being part of a group they dislike) is quite slim. Maybe one in a few thousand, with more extreme suffering being less likely by a few more orders of magnitude? The probablility that they have me killed for instrumental reasons, or otherwise waste the value of the future by my lights, is mich higher—ten percent-ish, depends on my distribution over who’s giving the orders. But this isn’t any worse to me than being killed by an AI that wants to replace me with molecular smiley faces.
To me, those odds each seem optimistic by a factor of about 1000, but ~reasonable relative to each other.
(I don’t see any low-cost way to find out why we disagree so strongly, though. Moving on, I guess.)
Makes sense (given your low odds for bad outcomes).
Do you also care about minds that are not you, though? Do you expect most future minds/persons that are brought into existence to have nice lives, if (say) Donald “Grab Them By The Pussy” Trump became god-emperor (and was the one deciding what persons/minds get to exist)?