This is interesting, but I would respond with two observations:
First, this story is supposed to invoke the idea that some AI we are attempting to box can figure out our own universe. Our universe is computable (to within the limits required for our current level of science). So as an allegory, it’s something we should be worried about.
Second, I like to think that some population of scientists in the story were pursuing the idea that the outer-universe might not be computable. If they had turned out to be right, I have a feeling we still would have figured out how to get out of the box eventually. It would have merely taken more time.
This is interesting, but I would respond with two observations:
First, this story is supposed to invoke the idea that some AI we are attempting to box can figure out our own universe. Our universe is computable (to within the limits required for our current level of science). So as an allegory, it’s something we should be worried about.
Second, I like to think that some population of scientists in the story were pursuing the idea that the outer-universe might not be computable. If they had turned out to be right, I have a feeling we still would have figured out how to get out of the box eventually. It would have merely taken more time.