The negative optimization power question is interesting. The zero-point of nonexistence seems totally legit, and I haven’t thought about it in that much detail before.
My intuition would be that negative optimization power reflects actively working against your values whenever you try anything, which definitely seems like it should be possible. Like, if I were an entity which launched a bomb at whatever I was trying to pay attention to, I would probably be negatively optimizing.
If you try and extrapolate through nonexistence as the zero though, things get weird. Negative optimization power then seems to reflect being an entity that the world is actively trying to prevent. At first glance that’s odd, but that also makes quite a bit of sense if you assume that the world contains other agents who might try to prevent you from doing things.
which definitely seems like it should be possible.
Yeah, this normal type of negative OP is possible with OP = EU’/|EU| and EU positive but decreasing. I’m worried about the weirdness of decreasing and negative EU.
The negative optimization power question is interesting. The zero-point of nonexistence seems totally legit, and I haven’t thought about it in that much detail before.
My intuition would be that negative optimization power reflects actively working against your values whenever you try anything, which definitely seems like it should be possible. Like, if I were an entity which launched a bomb at whatever I was trying to pay attention to, I would probably be negatively optimizing.
If you try and extrapolate through nonexistence as the zero though, things get weird. Negative optimization power then seems to reflect being an entity that the world is actively trying to prevent. At first glance that’s odd, but that also makes quite a bit of sense if you assume that the world contains other agents who might try to prevent you from doing things.
Yeah, this normal type of negative OP is possible with OP = EU’/|EU| and EU positive but decreasing. I’m worried about the weirdness of decreasing and negative EU.