This assumes that there’s some point where things sharply cut off between being me and not being me. I think it makes more sense for my utility function to care more about something the more similar it is to me. The existence of a single additional memory means pretty much nothing, and I still care a lot about most human minds. Something entirely alien I might not care about at all.
Even if this actually raises my utility, it does it by changing my utility function. Instead of helping the people I care about, it makes me care about different people.
Even if the cut-off is not sharp, something—which was completely not me—may become partly me after my simplification. Adding diffuse personality border is a correct step to the proper calculations of “me” and “not-me”, if we ever come to this level, but this doesn’t change the idea of the post: The simplification of the definition of “me” results in wider “bell curve” and thus larger share of all possible observer which are me.
This assumes that there’s some point where things sharply cut off between being me and not being me. I think it makes more sense for my utility function to care more about something the more similar it is to me. The existence of a single additional memory means pretty much nothing, and I still care a lot about most human minds. Something entirely alien I might not care about at all.
Even if this actually raises my utility, it does it by changing my utility function. Instead of helping the people I care about, it makes me care about different people.
Even if the cut-off is not sharp, something—which was completely not me—may become partly me after my simplification. Adding diffuse personality border is a correct step to the proper calculations of “me” and “not-me”, if we ever come to this level, but this doesn’t change the idea of the post: The simplification of the definition of “me” results in wider “bell curve” and thus larger share of all possible observer which are me.