When I was thinking about the concept of human brain emulation recently, a disturbing idea occurred to me. I have never seen anyone address it, so I suspect it is probably caused by my being deeply confused about either human neurobiology or computer science. I thought I’d ask about it in the hopes someone more informed would be able to explain it and the idea could stop bothering me:
Imagine that a brain emulation is in the process of being encoded into a storage medium. I don’t think that it is relevant whether the copy is being made from an organic brain or an existing emulation. Presumably it takes some amount of time to finish copying all the information onto the storage media. If the information is about a person’s values or personality, and it is only halfway copied, does that mean for a brief moment, before the copying process is complete, that the partial copy has very different personality or values from the original? Are the partially copied personality/values a different, simpler set of personality/values?
Presumably the copy is not conscious during the copying process, but I don’t think that affects the question. When people are unconscious they still have a personality and values stored in their brain somewhere, they are just not active at the moment.
I find this idea disturbing because it implies that emulating any brain (and possibly copying de novo AI as well) would inevitably result in creating and destroying multiple different personality/value sets that might count as separate people in some way. No one has ever brought this up as an ethical issue about uploads as far as I know (although I have never read “Age of Em” by Robin Hanson), and my background is not tech or neuroscience, so there is probably something I am missing .
Some of my theories of things I am missing include:
I am naively viewing personality/values as being stored in the brain in a simple, list-like format. For example, I may be imagining that someone who likes reading and jogging is being copied, and there is a brief period where the copy is someone who only likes reading because “jogging” has not been copied yet. In reality personality/values are probably distributed in the brain in some complex way that would not work like that. If they are only partially copied the emulation would simply crash, or not have values (be unmotivated). It would not have simpler or different values.
I am imagining brains as having one section for personality and values, and one section for instrumental things like thought and judgement. In reality this is not the case, the parts are close together enough that a partially copied brain would not be a simpler version of the original. It would just crash/go insane.
It might be theoretically possible to copy a brain in such a way that you could create a simpler version of the original with a simpler personality and values that would have a separate, distinct identity. But you’d have to do it really precisely and intentionally to get it to work. Normally partial copies would just not work/crash, unless they are so close to being completely copied that they are more like the original with mild brain damage/amnesia rather than like a different person.
Brain emulation would not involve literal neurons, it would involve code that says where a virtual neuron is. So having some code missing during copying would not result in the neurons rerouting into new paths that would develop into a new personality the way they might in someone with brain damage. The missing code would just result in the emulator program crashing.
I’d appreciate if someone with more knowledge about this issue, or programming/neuroscience would be willing to explain where my thinking about it is going wrong. I am interested in explanations that are conditional on brain emulation working. Obviously if brain emulation doesn’t work at all this issue won’t arise. Thank you in advance, it is an issue that I continue to find disturbing.
[Question] Would a halfway copied brain emulation be at risk of having different values/identity?
When I was thinking about the concept of human brain emulation recently, a disturbing idea occurred to me. I have never seen anyone address it, so I suspect it is probably caused by my being deeply confused about either human neurobiology or computer science. I thought I’d ask about it in the hopes someone more informed would be able to explain it and the idea could stop bothering me:
Imagine that a brain emulation is in the process of being encoded into a storage medium. I don’t think that it is relevant whether the copy is being made from an organic brain or an existing emulation. Presumably it takes some amount of time to finish copying all the information onto the storage media. If the information is about a person’s values or personality, and it is only halfway copied, does that mean for a brief moment, before the copying process is complete, that the partial copy has very different personality or values from the original? Are the partially copied personality/values a different, simpler set of personality/values?
Presumably the copy is not conscious during the copying process, but I don’t think that affects the question. When people are unconscious they still have a personality and values stored in their brain somewhere, they are just not active at the moment.
I find this idea disturbing because it implies that emulating any brain (and possibly copying de novo AI as well) would inevitably result in creating and destroying multiple different personality/value sets that might count as separate people in some way. No one has ever brought this up as an ethical issue about uploads as far as I know (although I have never read “Age of Em” by Robin Hanson), and my background is not tech or neuroscience, so there is probably something I am missing .
Some of my theories of things I am missing include:
I am naively viewing personality/values as being stored in the brain in a simple, list-like format. For example, I may be imagining that someone who likes reading and jogging is being copied, and there is a brief period where the copy is someone who only likes reading because “jogging” has not been copied yet. In reality personality/values are probably distributed in the brain in some complex way that would not work like that. If they are only partially copied the emulation would simply crash, or not have values (be unmotivated). It would not have simpler or different values.
I am imagining brains as having one section for personality and values, and one section for instrumental things like thought and judgement. In reality this is not the case, the parts are close together enough that a partially copied brain would not be a simpler version of the original. It would just crash/go insane.
It might be theoretically possible to copy a brain in such a way that you could create a simpler version of the original with a simpler personality and values that would have a separate, distinct identity. But you’d have to do it really precisely and intentionally to get it to work. Normally partial copies would just not work/crash, unless they are so close to being completely copied that they are more like the original with mild brain damage/amnesia rather than like a different person.
Brain emulation would not involve literal neurons, it would involve code that says where a virtual neuron is. So having some code missing during copying would not result in the neurons rerouting into new paths that would develop into a new personality the way they might in someone with brain damage. The missing code would just result in the emulator program crashing.
I’d appreciate if someone with more knowledge about this issue, or programming/neuroscience would be willing to explain where my thinking about it is going wrong. I am interested in explanations that are conditional on brain emulation working. Obviously if brain emulation doesn’t work at all this issue won’t arise. Thank you in advance, it is an issue that I continue to find disturbing.