I don’t think I understand. What is the third possible environment? And why exactly is the behavior stupid? It sounds like it might be actually true that it is too dangerous to test whether you are in Heaven or Hell in that situation.
The point is that Hell can be made arbitrarily likely by our choice of computing language—even in more complex environments, like our own world, thus creating an agent that does nothing (or that follows any particular policy).
I don’t think I understand. What is the third possible environment? And why exactly is the behavior stupid? It sounds like it might be actually true that it is too dangerous to test whether you are in Heaven or Hell in that situation.
Sorry, “two” possible environments, not three.
The point is that Hell can be made arbitrarily likely by our choice of computing language—even in more complex environments, like our own world, thus creating an agent that does nothing (or that follows any particular policy).
Ok, that makes sense.