These are good points. Perhaps I should not have said “interact” but chosen a different word instead. Still, its ability to play us is limited since (i) we will be examining the records of the world after it is dead (ii) it has no opportunity to learn anything about us.
Edit: we might even make it impossible for it to game us in the following way. All records of the simulated world are automatically deleted upon completion—except for a specific prime factorization we want to know.
This is a really bad argument for safety.
You are right, of course. But you wrote that in response to what was a parenthetical remark on my part—the real solution is to use program checking to make sure the laws of physics of the simulated world are never violated.
These are good points. Perhaps I should not have said “interact” but chosen a different word instead. Still, its ability to play us is limited since (i) we will be examining the records of the world after it is dead (ii) it has no opportunity to learn anything about us.
Edit: we might even make it impossible for it to game us in the following way. All records of the simulated world are automatically deleted upon completion—except for a specific prime factorization we want to know.
You are right, of course. But you wrote that in response to what was a parenthetical remark on my part—the real solution is to use program checking to make sure the laws of physics of the simulated world are never violated.