However, perhaps it can faithfully restore Will’s brain-state from recordings of Will in the minds of humanity anyway, if that’s what humanity would want. Alternatively Will is revived in ancestor simulations done by the FAI or any other FAI that is curious about humanity’s history around the time right before its singularity.
I am reasonably confident that no such process can produce an entity that I would identify as myself. Being reconstructed from other peoples’ memories means losing the memories of all inner thoughts, all times spent alone, and all times spent with people who have died or forgotten the occasion. That’s too much lost for any sort of continuity of consciousness.
Hm, well we can debate the magic powers a superintelligence possesses (whether or not it can raise the dead), but I think this would make Eliezer sad. I for one am not reasonably confident either way. I am not willing to put bounds on an entity that I am not sure won’t get access to an infinite amount of computation in finite time. At any rate, it seems we have different boundaries around identity. I’m having trouble removing the confusion about identity from my calculations.
I am reasonably confident that no such process can produce an entity that I would identify as myself. Being reconstructed from other peoples’ memories means losing the memories of all inner thoughts, all times spent alone, and all times spent with people who have died or forgotten the occasion. That’s too much lost for any sort of continuity of consciousness.
Hm, well we can debate the magic powers a superintelligence possesses (whether or not it can raise the dead), but I think this would make Eliezer sad. I for one am not reasonably confident either way. I am not willing to put bounds on an entity that I am not sure won’t get access to an infinite amount of computation in finite time. At any rate, it seems we have different boundaries around identity. I’m having trouble removing the confusion about identity from my calculations.