I generally share Tom McCabe’s conclusion, that is, that they exactly cancel out because a symmetry has not been broken. The reversed hypothesis has the same complexity as the original hypothesis, and the same evidence supporting it. No differential entanglement. However, I think that this problem is worth attention because a) so many people who normally agree disagree here, and b) I suspect that the problem is related to normal utilitarianism with no discounting and an unbounded future. Of course, we already have some solutions in that case and we should try them and see what we get. Our realistic AGI is boundedly rational in some respect to another. How does it’s limitation in predicting the mundane consequences of any given action relate to its limitation in predicting the probabilities in Pascal’s Mugging.
I generally share Tom McCabe’s conclusion, that is, that they exactly cancel out because a symmetry has not been broken. The reversed hypothesis has the same complexity as the original hypothesis, and the same evidence supporting it. No differential entanglement. However, I think that this problem is worth attention because a) so many people who normally agree disagree here, and b) I suspect that the problem is related to normal utilitarianism with no discounting and an unbounded future. Of course, we already have some solutions in that case and we should try them and see what we get. Our realistic AGI is boundedly rational in some respect to another. How does it’s limitation in predicting the mundane consequences of any given action relate to its limitation in predicting the probabilities in Pascal’s Mugging.