You could make it more convenient by it asking its operators before doing anything—the result would be pretty much the same.
The problem with this is that you assume that humans will be able to:
notice what the AI is planning
understand what the AI is planning
foresee the consequences of whatever it is planning
which greatly limits the usefulness of the system, in that it won’t be able to suggest anything radically different (or radically faster) from what a human would suggest—human oversight is the limiting factor of the whole system. It also encourages the AI to hide what it’s doing.
There is also the problem that given enough intelligence (computing speed, whatever think-oomph), it’ll still be able to think circles around its operators.
It could be somewhat helpful, for sure. And certainly better than nothing (unless it creates a false sense of security). Though I doubt it would be adopted, because of how much it would slow things down.
Yeah I guess it is more viable in a situation where there is a group far ahead of the competition who are also safety conscious. Don’t know how likely that is though.
You could make it more convenient by it asking its operators before doing anything—the result would be pretty much the same.
The problem with this is that you assume that humans will be able to:
notice what the AI is planning
understand what the AI is planning
foresee the consequences of whatever it is planning
which greatly limits the usefulness of the system, in that it won’t be able to suggest anything radically different (or radically faster) from what a human would suggest—human oversight is the limiting factor of the whole system. It also encourages the AI to hide what it’s doing.
There is also the problem that given enough intelligence (computing speed, whatever think-oomph), it’ll still be able to think circles around its operators.
I’m aware this idea has significant problems (like the ones you outlined), but could it still be better than other options?
We don’t want perfectionism to prevent us from taking highly flawed but still somewhat helpful safety measures.
It could be somewhat helpful, for sure. And certainly better than nothing (unless it creates a false sense of security). Though I doubt it would be adopted, because of how much it would slow things down.
Yeah I guess it is more viable in a situation where there is a group far ahead of the competition who are also safety conscious. Don’t know how likely that is though.