If the AI can rewrite its own code, it can replace itself with a no-op program, right? Or even if it can’t, maybe it can choose/commit to do nothing. So this approach hinges on what counts as “shutdown” to the AI.
If the AI can rewrite its own code, it can replace itself with a no-op program, right? Or even if it can’t, maybe it can choose/commit to do nothing. So this approach hinges on what counts as “shutdown” to the AI.