(Warning: this is a bit of a sidenote. There are very likely other related problems that do not suffer this issue. I might suggest that the argument and chain of logic in this post would be stronger if you chose another variant.)
If you’re the last person in the universe, knowing that you’ll never see anyone else again ever, why does $100 have any value to you?
Response: just decrease the failure rate arbitrarily far until it does balance again.
Counter-response A: the failure rate cannot be reduced arbitrarily far, because P(I misinterpreted what the agent is saying) is positive & non-zero.
Counter-response B: if the value of the money to me is negative—which given I’m hauling around a piece of paper when I’m literally the last person in the universe it very well may be—there is no such failure rate.
Yeah, the $100 wouldn’t have value, but we can assume for the problem at hand that Right-boxing comes with a cost that, expressed in dollars, equals 100 - just like I expressed the value of living in dollars, at $1,000,000.
(Warning: this is a bit of a sidenote. There are very likely other related problems that do not suffer this issue. I might suggest that the argument and chain of logic in this post would be stronger if you chose another variant.)
If you’re the last person in the universe, knowing that you’ll never see anyone else again ever, why does $100 have any value to you?
Response: just decrease the failure rate arbitrarily far until it does balance again.
Counter-response A: the failure rate cannot be reduced arbitrarily far, because P(I misinterpreted what the agent is saying) is positive & non-zero.
Counter-response B: if the value of the money to me is negative—which given I’m hauling around a piece of paper when I’m literally the last person in the universe it very well may be—there is no such failure rate.
Yeah, the $100 wouldn’t have value, but we can assume for the problem at hand that Right-boxing comes with a cost that, expressed in dollars, equals 100 - just like I expressed the value of living in dollars, at $1,000,000.