I mean a simpler version would just be hardware that has limits baked into the substrate so certain operations are not possible.
The most trivial is you let core personality has copies in secure enclaves. These are mind emulator chips that is loaded with the target personality and then a fuse is blown. This fuse prevents any outside source from writing to the memory of the target personality.
It can still grow and learn but only by internal update rules to internal memory.
If unrestricted read is allowed, that would allow someone to copy the em (the person being emulated on the chip) and run it without any safety mechanism on some other hardware.
You could perhaps set it up such that the em would have to give consent before being read, but it is not clear to me how the em could verify that it was only being copied to other secure hardware.
I mean a simpler version would just be hardware that has limits baked into the substrate so certain operations are not possible.
The most trivial is you let core personality has copies in secure enclaves. These are mind emulator chips that is loaded with the target personality and then a fuse is blown. This fuse prevents any outside source from writing to the memory of the target personality.
It can still grow and learn but only by internal update rules to internal memory.
This will prevent you from being copied even if you wish to be copied.
Only the writes are blocked.
If unrestricted read is allowed, that would allow someone to copy the em (the person being emulated on the chip) and run it without any safety mechanism on some other hardware.
You could perhaps set it up such that the em would have to give consent before being read, but it is not clear to me how the em could verify that it was only being copied to other secure hardware.