Yes, this is correct; an AGI that did this would self-modify into a stable and effective utility maximizer of the same utility function it started with. However, this strategy is computationally impossible, and perhaps more importantly, it does not lend itself well to approximation.
Yes, this is correct; an AGI that did this would self-modify into a stable and effective utility maximizer of the same utility function it started with. However, this strategy is computationally impossible, and perhaps more importantly, it does not lend itself well to approximation.