I’m not sure this reasoning actually holds in reality. A simulation focused AI acting on chaos theory type reasoning will have no reason to restrict attention to its physical vicinity. Meanwhile, the roof could have been painted scarlet for a reason as simple as “it was the cheapest colour of rust resistant paint”. or It shows up well against a background of low lying fog, so aeroplanes can see the roof. I am not saying they made the wrong decision, that depends on priors and utilities. I am saying I wouldn’t be confidant in their explanation without other evidence.
I’m not sure this reasoning actually holds in reality. A simulation focused AI acting on chaos theory type reasoning will have no reason to restrict attention to its physical vicinity. Meanwhile, the roof could have been painted scarlet for a reason as simple as “it was the cheapest colour of rust resistant paint”. or It shows up well against a background of low lying fog, so aeroplanes can see the roof. I am not saying they made the wrong decision, that depends on priors and utilities. I am saying I wouldn’t be confidant in their explanation without other evidence.