These are some good possible solutions but there could be some problems. The first solution implies that the observer is a separate entity from the body, and an observer has a certain probability of “being inside” a certain copy every smallest possible unit of time. But what is the connection between these different copies? They aren’t really copies at all, they’re all different people. And what is the observer actually made of? So at this point it seems to imply open individualism. Of course, there is currently no universally accepted theory for personal identity so this could be true.
And in the second solution, the suffering maximiser has 2 choices: it can either create no suffering at all for fear of being punished by friendly AI, or it can create suffering and take the risk. In the first case, the probability of creating suffering is 0 which is the worst thing possible for the suffering maximiser, so it will take the second choice, where there is a chance that it will not be punished and will be able to create at least some amount of suffering.
1. True, depends on the nature of personal identity. However, if some finite form of identity is true, I should not worry about “hostile resurrection”: that future AI steal information about me and create my copy and will torture me. This closes possibility of many bad outcomes.
2. More likely to work for “instrumental sufferings maximiser”, which may use human sufferings for blackmail. For AI, which has final goal of suffering maximising, where could be some compromise: it allows to torture one person for one second. And as I suggested this idea, I have to volunteer to be this person.
These are some good possible solutions but there could be some problems. The first solution implies that the observer is a separate entity from the body, and an observer has a certain probability of “being inside” a certain copy every smallest possible unit of time. But what is the connection between these different copies? They aren’t really copies at all, they’re all different people. And what is the observer actually made of? So at this point it seems to imply open individualism. Of course, there is currently no universally accepted theory for personal identity so this could be true.
And in the second solution, the suffering maximiser has 2 choices: it can either create no suffering at all for fear of being punished by friendly AI, or it can create suffering and take the risk. In the first case, the probability of creating suffering is 0 which is the worst thing possible for the suffering maximiser, so it will take the second choice, where there is a chance that it will not be punished and will be able to create at least some amount of suffering.
1. True, depends on the nature of personal identity. However, if some finite form of identity is true, I should not worry about “hostile resurrection”: that future AI steal information about me and create my copy and will torture me. This closes possibility of many bad outcomes.
2. More likely to work for “instrumental sufferings maximiser”, which may use human sufferings for blackmail. For AI, which has final goal of suffering maximising, where could be some compromise: it allows to torture one person for one second. And as I suggested this idea, I have to volunteer to be this person.