Fortunately, there’s a correlation between situations where (i) AI takeover risk is high, and (ii) AIs have a good understanding of the world. If AI developers have perfect ability to present the AI with false impressions of the world, then the risk from AI takeover is probably low. While if AIs have substantial ability to distinguish truth from falsehood, then perhaps that channel can also be used to communicate facts about the world.
Whether this is fortunate depends a lot on how beneficial communication with unaligned AIs is. If unaligned AI with high chance of takeover can exploit trade to further increase its chances of takeover (“Oh, I just have short-term preferences where I want you to run some scientific simulations for me”), then this correlation is the opposite of fortunate. If people increase an unaligned AI’s situational awareness so it can trust our trade offer, then the correlation seems indirectly bad for us.
Whether this is fortunate depends a lot on how beneficial communication with unaligned AIs is. If unaligned AI with high chance of takeover can exploit trade to further increase its chances of takeover (“Oh, I just have short-term preferences where I want you to run some scientific simulations for me”), then this correlation is the opposite of fortunate. If people increase an unaligned AI’s situational awareness so it can trust our trade offer, then the correlation seems indirectly bad for us.