I don’t see why the FAI creators would base the CEV on anyone other than themselves except to the extent that they need to do so for political reasons. The result of this would by definition be optimal for the creators.
I don’t see why the FAI creators would base the CEV on anyone other than themselves except to the extent that they need to do so for political reasons. The result of this would by definition be optimal for the creators.
No, not “by definition”. I advised against that idea specifically in the penultimate paragraph of my essay. One reason for this is that the programmers are not infallible, therefore if they face more challenges in programming a dynamic that can cope with one specific group of people in comparison to another group of people, then there’s no reason why the output of from a CEV dynamic including the second group should not be closer to the output of an ideal CEV including the first group.
Another reason: we generally consider individual humans to have interests—not groups of humans. To take the extreme case as a sufficient disproof, an FAI programmer would prefer the CEV to include 1000 kind people not including himself, rather than himself and 999 psychopaths.
The FAI programming group or any other group should not be reified as having interests of its own (as in “optimal for the creators”).
In any case, “if my Auntie had...”—political reasons do exist!
Your first paragraph seems like a technical issue that may or may not apply in practice, not something that really gets at the heart of CEV. For the second paragraph, I guess I was thinking of the limiting case of there being a single creator of the FAI. With groups, it presumably depends on the extent to which you believe (or can measure) that the average individual from some other group is a better match for your CEV than your FAI co-workers are. But if that’s the case then those co-workers will want to include different groups of their own!
I do agree that political issues may be very important in practice though—for example, “we’ll fund you only if you include such-and-such people’s CEV”.
I don’t see why the FAI creators would base the CEV on anyone other than themselves except to the extent that they need to do so for political reasons.
For moral reasons (although if these are true moral reasons, CEV would do that anyway, this particular error seems easy to correct).
I don’t see why the FAI creators would base the CEV on anyone other than themselves except to the extent that they need to do so for political reasons. The result of this would by definition be optimal for the creators.
Considering your other comments, I’m confident you can answer this for yourself with a few hundred seconds worth of thought.
What is that supposed to mean? (It sounds like an oblique insult but I don’t want to jump to negative conclusions).
It was intended as the opposite.
No, not “by definition”. I advised against that idea specifically in the penultimate paragraph of my essay. One reason for this is that the programmers are not infallible, therefore if they face more challenges in programming a dynamic that can cope with one specific group of people in comparison to another group of people, then there’s no reason why the output of from a CEV dynamic including the second group should not be closer to the output of an ideal CEV including the first group.
Another reason: we generally consider individual humans to have interests—not groups of humans. To take the extreme case as a sufficient disproof, an FAI programmer would prefer the CEV to include 1000 kind people not including himself, rather than himself and 999 psychopaths.
The FAI programming group or any other group should not be reified as having interests of its own (as in “optimal for the creators”).
In any case, “if my Auntie had...”—political reasons do exist!
Your first paragraph seems like a technical issue that may or may not apply in practice, not something that really gets at the heart of CEV. For the second paragraph, I guess I was thinking of the limiting case of there being a single creator of the FAI. With groups, it presumably depends on the extent to which you believe (or can measure) that the average individual from some other group is a better match for your CEV than your FAI co-workers are. But if that’s the case then those co-workers will want to include different groups of their own!
I do agree that political issues may be very important in practice though—for example, “we’ll fund you only if you include such-and-such people’s CEV”.
For moral reasons (although if these are true moral reasons, CEV would do that anyway, this particular error seems easy to correct).