“Fruit” is a natural category; apples and oranges share interesting characteristics that make it useful to talk about them in general.
“Utility” is not. The two concepts, “that for which expectation is legitimate”, and some quantity related to inter-agent preference aggregation do not share very many characteristics, and they are not even on the same conceptual abstraction layer.
The VNM-stuff is about decision theory. The preference aggregation stuff is about moral philosophy. Those should be completely firewalled. There is no value to a superconcept that crosses that boundary.
As for me using the word “utility” in this discussion, I think it should be unambiguous that I am speaking of VNM-stuff, because the OP is about VNM, and utilitarianism and VNM do not belong in the same discussion, so you can infer that all uses of “utility” refer to the same thing. Nevertheless, I will try to come up with a less ambiguous word to refer to the output of a “preference function”.
The VNM-stuff is about decision theory. The preference aggregation stuff is about moral philosophy. Those should be completely firewalled. There is no value to a superconcept that crosses that boundary.
But surely the intuition that value ought to be aggregated linearly across “possible outcomes” is related to the intuition that value ought to be aggregated linearly across “individuals”? I think it basically comes down to independence: how much something (a lottery over possible outcomes / a set of individuals) is valued should be independent of other things (other parts of the total probabilistic mixture over outcomes / other individuals who exist).
When framed this way, the two problems in decision theory and moral philosophy can be merged together as the question of “where should one draw the boundary between things that are valued independently?” and the general notion of “utility” as “representation of preference that can be evaluated on certain objects independently of others and then aggregated linearly” does seem to have value.
There is no value to a superconcept that crosses that boundary.
This doesn’t seem to me to argue in favour of using wording that’s associated with the (potentially illegitimate) superconcept to refer to one part of it. Also, the post you were responding to (conf)used both concepts of utility, so by that stage, they were already in the same discussion, even if they didn’t belong there.
Two additional things, FWIW:
(1) There’s a lot of existing literature that distinguishes between “decision utility” and “experienced utility” (where “decision utility” corresponds to preference representation) so there is an existing terminology already out there. (Although “experienced utility” doesn’t necessarily have anything to do with preference or welfare aggregation either.)
(2) I view moral philosophy as a special case of decision theory (and e.g. axiomatic approaches and other tools of decision theory have been quite useful in to moral philosophy), so to the extent that your firewall intends to cut that off, I think it’s problematic. (Not sure that’s what you intend—but it’s one interpretation of your words in this comment.) Even Harsanyi’s argument, while flawed, is interesting in this regard (it’s much more sophisticated than Phil’s post, so I’d recommend checking it out if you haven’t already.)
“Fruit” is a natural category; apples and oranges share interesting characteristics that make it useful to talk about them in general.
“Utility” is not. The two concepts, “that for which expectation is legitimate”, and some quantity related to inter-agent preference aggregation do not share very many characteristics, and they are not even on the same conceptual abstraction layer.
The VNM-stuff is about decision theory. The preference aggregation stuff is about moral philosophy. Those should be completely firewalled. There is no value to a superconcept that crosses that boundary.
As for me using the word “utility” in this discussion, I think it should be unambiguous that I am speaking of VNM-stuff, because the OP is about VNM, and utilitarianism and VNM do not belong in the same discussion, so you can infer that all uses of “utility” refer to the same thing. Nevertheless, I will try to come up with a less ambiguous word to refer to the output of a “preference function”.
But surely the intuition that value ought to be aggregated linearly across “possible outcomes” is related to the intuition that value ought to be aggregated linearly across “individuals”? I think it basically comes down to independence: how much something (a lottery over possible outcomes / a set of individuals) is valued should be independent of other things (other parts of the total probabilistic mixture over outcomes / other individuals who exist).
When framed this way, the two problems in decision theory and moral philosophy can be merged together as the question of “where should one draw the boundary between things that are valued independently?” and the general notion of “utility” as “representation of preference that can be evaluated on certain objects independently of others and then aggregated linearly” does seem to have value.
This doesn’t seem to me to argue in favour of using wording that’s associated with the (potentially illegitimate) superconcept to refer to one part of it. Also, the post you were responding to (conf)used both concepts of utility, so by that stage, they were already in the same discussion, even if they didn’t belong there.
Two additional things, FWIW:
(1) There’s a lot of existing literature that distinguishes between “decision utility” and “experienced utility” (where “decision utility” corresponds to preference representation) so there is an existing terminology already out there. (Although “experienced utility” doesn’t necessarily have anything to do with preference or welfare aggregation either.)
(2) I view moral philosophy as a special case of decision theory (and e.g. axiomatic approaches and other tools of decision theory have been quite useful in to moral philosophy), so to the extent that your firewall intends to cut that off, I think it’s problematic. (Not sure that’s what you intend—but it’s one interpretation of your words in this comment.) Even Harsanyi’s argument, while flawed, is interesting in this regard (it’s much more sophisticated than Phil’s post, so I’d recommend checking it out if you haven’t already.)