As far as I understand, this post decomoses ‘impact’ into value impact and objective impact. VI is dependent on some agent’s ability to reach arbitrary value-driven goals, while OI depends on any agent’s ability to reach goals in general.
I’m not sure if there exists a robust distinction between the two—the post doesn’t discuss any general demarcation tool.
Maybe I’m wrong, but I think the most important point to note here is that ‘objectiveness’ of an impact is defined not to be about the ‘objective state of the world’ - rather about how ‘general to all agents’ an impact is.
VI is dependent on some agent’s ability to reach arbitrary value-driven goals, while OI depends on any agent’s ability to reach goals in general.
VI depends on the ability to do one kind of goal in particular, like human values. OI depends on goals in general.
I’m not sure if there exists a robust distinction between the two—the post doesn’t discuss any general demarcation tool.
If I understand correctly, this is wondering whether there are some impacts that count for ~50% of all agents, or 10%, or .01% - where do we draw the line? It seems to me that any natural impact (that doesn’t involve something crazy like “if the goal encoding starts with ‘0’, shut them off; otherwise, leave them alone”) either affects a very low percentage of agents or a very high percentage of agents. So, I’m not going to draw an exact line, but I think it should be intuitively obvious most of the time.
Maybe I’m wrong, but I think the most important point to note here is that ‘objectiveness’ of an impact is defined not to be about the ‘objective state of the world’ - rather about how ‘general to all agents’ an impact is
As far as I understand, this post decomoses ‘impact’ into value impact and objective impact. VI is dependent on some agent’s ability to reach arbitrary value-driven goals, while OI depends on any agent’s ability to reach goals in general.
I’m not sure if there exists a robust distinction between the two—the post doesn’t discuss any general demarcation tool.
Maybe I’m wrong, but I think the most important point to note here is that ‘objectiveness’ of an impact is defined not to be about the ‘objective state of the world’ - rather about how ‘general to all agents’ an impact is.
VI depends on the ability to do one kind of goal in particular, like human values. OI depends on goals in general.
If I understand correctly, this is wondering whether there are some impacts that count for ~50% of all agents, or 10%, or .01% - where do we draw the line? It seems to me that any natural impact (that doesn’t involve something crazy like “if the goal encoding starts with ‘0’, shut them off; otherwise, leave them alone”) either affects a very low percentage of agents or a very high percentage of agents. So, I’m not going to draw an exact line, but I think it should be intuitively obvious most of the time.
This is exactly it.