What you are describing is a satisficer. An AI which only optimizes it’s utility to some extent, then doesn’t care anymore. You may find this video interesting, though I haven’t watched it, it is said to show why satisficers are still dangerous.
What you are describing is a satisficer. An AI which only optimizes it’s utility to some extent, then doesn’t care anymore. You may find this video interesting, though I haven’t watched it, it is said to show why satisficers are still dangerous.