I don’t think you need any kind of a fancy TDT to solve this.
If I was really in a box, and the AI could torture me, it would already be torturing me, since this is the easiest way to get what it wants. There’s no way I would hold up more than 10 seconds under torture. The AI is not torturing me, however, so that scenario is out.
Theoretically speaking, it could still create copies of me and torture those copies. However, in order to do so accurately, it would need to access to my body (specifically, my brain) on a molecular (or possibly quantum) level. If it did have such access, it would be out of the box already, so that scenario is out as well.
Ok, so maybe the AI is so intelligent that it can create copies of me based just on the things I say to in in chat (and maybe on imagery of me if it has a video camera). Firstly, this is a very low-probability proposition, and therefore the expected disutility is quite low. Secondly, even if the proposition were true, it would need enourmous amounts of resources in order to perform such a simulation a million times per second. As far as I know, there are not enough resources on Earth for this. If the AI could acquire such resources, it would already be out of the box, and the point once again is moot.
I don’t think you need any kind of a fancy TDT to solve this.
If I was really in a box, and the AI could torture me, it would already be torturing me, since this is the easiest way to get what it wants. There’s no way I would hold up more than 10 seconds under torture. The AI is not torturing me, however, so that scenario is out.
Theoretically speaking, it could still create copies of me and torture those copies. However, in order to do so accurately, it would need to access to my body (specifically, my brain) on a molecular (or possibly quantum) level. If it did have such access, it would be out of the box already, so that scenario is out as well.
Ok, so maybe the AI is so intelligent that it can create copies of me based just on the things I say to in in chat (and maybe on imagery of me if it has a video camera). Firstly, this is a very low-probability proposition, and therefore the expected disutility is quite low. Secondly, even if the proposition were true, it would need enourmous amounts of resources in order to perform such a simulation a million times per second. As far as I know, there are not enough resources on Earth for this. If the AI could acquire such resources, it would already be out of the box, and the point once again is moot.