It comes back to the same issue again: do you value exact duplicates having exactly the same experience as a sum, or is that the same as one copy having it (equivalent to an average)? Or something in between?
Let’s see. If I had memories of being in many anthropic situations, and the frequencies in these memories agreed with SIA to the tenth decimal place, I would probably value my copies according to SIA. Likewise with SSA. So today, before I have any such memories, I seem to be a value-learning agent who’s willing to adopt either SIA or SSA (or something else) depending on future experiences or arguments.
You seem to be saying that it’s better for me to get rid of value learning, replacing it with some specific way of valuing copies. If so, how should I choose which?
It comes back to the same issue again: do you value exact duplicates having exactly the same experience as a sum, or is that the same as one copy having it (equivalent to an average)? Or something in between?
Let’s see. If I had memories of being in many anthropic situations, and the frequencies in these memories agreed with SIA to the tenth decimal place, I would probably value my copies according to SIA. Likewise with SSA. So today, before I have any such memories, I seem to be a value-learning agent who’s willing to adopt either SIA or SSA (or something else) depending on future experiences or arguments.
You seem to be saying that it’s better for me to get rid of value learning, replacing it with some specific way of valuing copies. If so, how should I choose which?
Edit: I’ve expanded this idea to a post.