I am getting the feeling that you’re assuming there’s something in the agent’s code that says, “you can look at and change any line of code you want, except lines 12345..99999, because that’s where your terminal goals are”. Is that right ?
You can change that line, but it will result in you optimizing for something other than paperclips, resulting in less paperclips.
You can change that line, but it will result in you optimizing for something other than paperclips, resulting in less paperclips.