Depends on what value the FAI places on human flourishing in hypothetical alternate realities I guess. If it’s focused on the universe it’s in then there’s no reason to waste half of it on paperclips. If it’s trying to help out the people living in a universe where the paperclip maximizer got activated then it should cooperate. I guess a large part of that is also about whether it determines there really are parallel universes or not to be concerned about.
Depends on what value the FAI places on human flourishing in hypothetical alternate realities I guess. If it’s focused on the universe it’s in then there’s no reason to waste half of it on paperclips. If it’s trying to help out the people living in a universe where the paperclip maximizer got activated then it should cooperate. I guess a large part of that is also about whether it determines there really are parallel universes or not to be concerned about.