This is closely related to the issue of “stopping”—which has been previously discussed by me on:
http://alife.co.uk/essays/stopping_superintelligence/
A common framing of the discussion is in terms of “satisficing”—a term apparently coined by Herbert Simon.
There is a previous discussion of this whole issue on this site here.
This is closely related to the issue of “stopping”—which has been previously discussed by me on:
http://alife.co.uk/essays/stopping_superintelligence/
A common framing of the discussion is in terms of “satisficing”—a term apparently coined by Herbert Simon.
There is a previous discussion of this whole issue on this site here.