One lesson you could draw from this is that, as part of your definition of what a “paperclip” is, you should include the AI putting a high value upon being honest with the programmer (about its aims, tactics and current ability levels) and not deliberately trying to game, tempt or manipulate the programmer.
One lesson you could draw from this is that, as part of your definition of what a “paperclip” is, you should include the AI putting a high value upon being honest with the programmer (about its aims, tactics and current ability levels) and not deliberately trying to game, tempt or manipulate the programmer.