Maybe we should just work off of the assumption that there’s no relevant uncomputable physics, because if there were, we should probably give up our endeavors anyways, unless we knew how to model an uncomputable reality within a computable AGI-program. As Schmidhuber ever so aptly wrote on his homepage:
The distribution should at least be computable in the limit. That is, there should exist a program that takes as an input any beginning of the universe history as well as a next possible event, and produces an output converging on the conditional probability of the event. If there were no such program we could not even formally specify our universe, leave alone writing reasonable scientific papers about it.
That makes sense from a simulationist perspective, you’re trying to diminish your impact within the simulation, getting away as far as possible from being a nexus.
Why?
So that resources are allocated away from you, if you take the simulation to be a dynamic—if mindless—process?
Or because you are afraid you’re otherwise going to … draw attention to yourself? From … your simulators? You might call them god, or maybe they might not like that.
You’d have to strike a careful balance, become too insignificant and you might just be demoted to NPC status, being down NICE’ed, so to speak.