That’s right. Functional instruction-following is surprisingly close to all you need.
The one exception is that you need to somehow get it to prioritize future instructions. An obvious subgoal of fully completing any given instruction is making sure no authorized party gives you a different instruction before you’ve finished.
That is not what we’re training for now. Models currently aren’t smart enough to work through the full logic of every request, but they will be.
You could argue that every instruction has an implicit “unless I change my mind or you misunderstood what I meant,” and to some degree they do. But making sure that subtlety gets through isn’t something we’re training or testing for explicitly yet.
If the model’s goal is to do what you want, and you originally wanted the model to let you change the goals you gave it, then the model ought to understand that (since it’s not dumb) and let you change the goals you gave it..
It is generally implicit in an instruction that you don’t want to simply be mislead about its completion.
That’s right. Functional instruction-following is surprisingly close to all you need.
The one exception is that you need to somehow get it to prioritize future instructions. An obvious subgoal of fully completing any given instruction is making sure no authorized party gives you a different instruction before you’ve finished.
That is not what we’re training for now. Models currently aren’t smart enough to work through the full logic of every request, but they will be.
You could argue that every instruction has an implicit “unless I change my mind or you misunderstood what I meant,” and to some degree they do. But making sure that subtlety gets through isn’t something we’re training or testing for explicitly yet.
If the model’s goal is to do what you want, and you originally wanted the model to let you change the goals you gave it, then the model ought to understand that (since it’s not dumb) and let you change the goals you gave it..