Wouldn’t you program the human AI to play defect against the paperclipper, assuming that there is no way for the AIs to prove their source codes to each other?
Whatever I decide on this point, I expect FAI programmers in general to decide the same; and I expect the paperclipper to know what FAI programmers in general do, through simulations or higher-level reasoning, and act accordingly. So, no.
Whatever I decide on this point, I expect FAI programmers in general to decide the same; and I expect the paperclipper to know what FAI programmers in general do, through simulations or higher-level reasoning, and act accordingly. So, no.