And yes, if one’s own preferences are the foundation of ethics, most philosophers would simply call this subject matter practical rationality rather than morality.
They would be missing some important distinctions between what we think of as our moral values and what we think of as “chocolate/vanilla” preferences. For one obvious example, consider an alien ray gun that ‘switches the way I feel’ about two things, X and Y, without otherwise affecting my utility function or anything else of value to me.
If X were, say, licorice jelly beans (yum) and Y were, say, buttered popcorn jelly beans (yuck), then I wouldn’t be too deeply bothered by the prospect of being zapped with this gun. (Same for sexual preference, etc.) But if X were “autonomy of individuals” and Y were “uniformity of individuals”, I would flee screaming from the prospect of being messed with that way, and would take some extreme actions (if I knew I’d be zapped) to prevent my new preferences from having large effects in the world.
Now we can develop whole theories about what this kind of difference consists in, but it’s at least relevant to the question of metaethics. In fact, I think that calling this wider class of volitions “preferences” is sneaking in an unfortunate connotation that they “shouldn’t really matter then”.
This sounds, to me, like it’s just the distinction between terminal and instrumental values. I don’t terminally value eating licorice jelly beans, I just like the way they taste and the feeling of pleasure they give me. If you switched the tastes of buttered popcorn jelly beans (yuck indeed) and licorice jelly beans, that would be fine by me. Hell, it would be an improvement since no one else likes that flavor (more for me!). The situation is NOT the same for “autonomy of individuals” and “uniformity of individuals” before I really do have terminal values for these things, apart from the way they make me feel.
The situation is NOT the same for “autonomy of individuals” and “uniformity of individuals” before I really do have terminal values for these things, apart from the way they make me feel.
How do you know that?
What would you expect to experience if your preference for individual autonomy in fact derived from something else?
I agree that by using a single term for the wider class of volitions—for example, by saying both that I “prefer” autonomy to uniformity and also that I “prefer” male sexual partners to female ones and also that I “prefer” chocolate to vanilla—I introduce the connotation that the distinctions between these various “preferences” aren’t important in the context of discourse.
To call that an unfortunate connotation is question-begging. Sometimes we deliberately adopt language that elides a distinction in a particular context, precisely because we don’t believe that distinction ought to be made in that context.
For example, in a context where I believe skin color ought not matter, I may use language that elides the distinction between skin colors. I may do this even if I care about that distinction: for example, if I observe that I do, in fact, care about my doctor’s skin color, but I don’t endorse caring about it, I might start using language that elides that distinction as a way of changing the degree to which I care about it.
So it seems worth asking whether, in the particular context you’re talking about, the connotations introduced by the term “preferences” are in fact unfortunate.
For instance, you class sexual preference among the “chocolate/vanilla” preferences for which the implication that they “shouldn’t really matter” is appropriate.
I would likely have agreed with you twenty years ago, when I had just broken up with my girlfriend and hadn’t yet started dating my current husband. OTOH, today I would likely “flee screaming” from a ray that made me heterosexual, since that would vastly decrease the value to me of my marriage.
Of course, you may object that this sort of practical consequence isn’t what you mean. But there are plenty of people who would “flee screaming” from a sexual-preference-altering ray for what they classify as moral reasons, without reference to practical consequences. And perhaps I’m one of them… after all, it’s not clear to me that my desire to preserve my marriage isn’t a “moral value.”
Indeed, it seems that there simply is no consistent fact of the matter as to whether my sexual preference is a “flee screaming” thing or not… it seems to depend on my situation. 20-year-old single me and 40-year-old married me disagree, and if tomorrow I were single again perhaps I’d once again change my mind.
Now, perhaps that just means that for me, sexual preference is a mere instrumental value, best understood in terms of what other benefits I get from it being one way or another, and is therefore a poor example of the distinction you’re getting at, and I should pick a different example.
On the other hand, just because I pick an different preference P such that I can’t imagine how a change in environment or payoff matrix might change P, doesn’t mean that P actually belongs in a different class from sexual preference. It might be equally true that a similarly pragmatic change would change P, I just can’t imagine the change that would do it.
Perhaps, under the right circumstances, I would not wish to flee from an autonomy/uniformity switching ray.
My point is that it’s not clear to me that it’s a mistake to elide over the distinction between moral values and aesthetic preferences. Maybe calling all of these things “preferences” is instead an excellent way of introducing the fortunate connotation that the degree to which any of them matter is equally arbitrary and situational, however intense the feeling that some preferences are “moral values” or “terminal values” or whatever other privileged term we want to apply to them.
20-year-old single me and 40-year-old married me disagree
These are two different people, many objections from the fact they disagree one ought to have from the fact that one and some random other contemporary person disagree.
And yet, a lot of our culture presumes that there are important differences between the two.
E.g., culturally we think it’s reasonable for someone at 20 to make commitments that are binding on that person at 40, whereas we think it’s really strange for someone at 20 or 40 to make commitments that are binding on some random other contemporary person.
Ah, sexual preference was a poor example in general– in my case, being single at the moment means I wouldn’t be injuring anybody if my preferences changed. Were I in a serious relationship, I’d flee from the ray gun too.
I personally don’t get that connotation from the term “preferences,” but I’m sure others do.
Anyway, so… Eliezer distinguishes prudential oughts from moral oughts by saying that moral oughts are what we ought to do to satisfy some small subset of our preferences: preferences that we wouldn’t want changed by an alien ray gun? I thought he was saying that I morally should_Luke do what will best satisfy a global consideration of my preferences.
No, no, no- I don’t mean that what I pointed out was the only distinction or the fundamental distinction, just that there’s a big honking difference in at least one salient way. I’m not speaking for Eliezer on what’s the best way to carve up that cluster in concept-space.
They would be missing some important distinctions between what we think of as our moral values and what we think of as “chocolate/vanilla” preferences. For one obvious example, consider an alien ray gun that ‘switches the way I feel’ about two things, X and Y, without otherwise affecting my utility function or anything else of value to me.
If X were, say, licorice jelly beans (yum) and Y were, say, buttered popcorn jelly beans (yuck), then I wouldn’t be too deeply bothered by the prospect of being zapped with this gun. (Same for sexual preference, etc.) But if X were “autonomy of individuals” and Y were “uniformity of individuals”, I would flee screaming from the prospect of being messed with that way, and would take some extreme actions (if I knew I’d be zapped) to prevent my new preferences from having large effects in the world.
Now we can develop whole theories about what this kind of difference consists in, but it’s at least relevant to the question of metaethics. In fact, I think that calling this wider class of volitions “preferences” is sneaking in an unfortunate connotation that they “shouldn’t really matter then”.
This sounds, to me, like it’s just the distinction between terminal and instrumental values. I don’t terminally value eating licorice jelly beans, I just like the way they taste and the feeling of pleasure they give me. If you switched the tastes of buttered popcorn jelly beans (yuck indeed) and licorice jelly beans, that would be fine by me. Hell, it would be an improvement since no one else likes that flavor (more for me!). The situation is NOT the same for “autonomy of individuals” and “uniformity of individuals” before I really do have terminal values for these things, apart from the way they make me feel.
How do you know that?
What would you expect to experience if your preference for individual autonomy in fact derived from something else?
It was meant as a hypothetical. I don’t actually know.
Ah. Sorry; I thought you were endorsing the idea.
Huh? You simply weigh “chocolate/vanilla” preferences differently than decisions that would affect goal-oriented agents.
I agree that by using a single term for the wider class of volitions—for example, by saying both that I “prefer” autonomy to uniformity and also that I “prefer” male sexual partners to female ones and also that I “prefer” chocolate to vanilla—I introduce the connotation that the distinctions between these various “preferences” aren’t important in the context of discourse.
To call that an unfortunate connotation is question-begging. Sometimes we deliberately adopt language that elides a distinction in a particular context, precisely because we don’t believe that distinction ought to be made in that context.
For example, in a context where I believe skin color ought not matter, I may use language that elides the distinction between skin colors. I may do this even if I care about that distinction: for example, if I observe that I do, in fact, care about my doctor’s skin color, but I don’t endorse caring about it, I might start using language that elides that distinction as a way of changing the degree to which I care about it.
So it seems worth asking whether, in the particular context you’re talking about, the connotations introduced by the term “preferences” are in fact unfortunate.
For instance, you class sexual preference among the “chocolate/vanilla” preferences for which the implication that they “shouldn’t really matter” is appropriate.
I would likely have agreed with you twenty years ago, when I had just broken up with my girlfriend and hadn’t yet started dating my current husband. OTOH, today I would likely “flee screaming” from a ray that made me heterosexual, since that would vastly decrease the value to me of my marriage.
Of course, you may object that this sort of practical consequence isn’t what you mean. But there are plenty of people who would “flee screaming” from a sexual-preference-altering ray for what they classify as moral reasons, without reference to practical consequences. And perhaps I’m one of them… after all, it’s not clear to me that my desire to preserve my marriage isn’t a “moral value.”
Indeed, it seems that there simply is no consistent fact of the matter as to whether my sexual preference is a “flee screaming” thing or not… it seems to depend on my situation. 20-year-old single me and 40-year-old married me disagree, and if tomorrow I were single again perhaps I’d once again change my mind.
Now, perhaps that just means that for me, sexual preference is a mere instrumental value, best understood in terms of what other benefits I get from it being one way or another, and is therefore a poor example of the distinction you’re getting at, and I should pick a different example.
On the other hand, just because I pick an different preference P such that I can’t imagine how a change in environment or payoff matrix might change P, doesn’t mean that P actually belongs in a different class from sexual preference. It might be equally true that a similarly pragmatic change would change P, I just can’t imagine the change that would do it.
Perhaps, under the right circumstances, I would not wish to flee from an autonomy/uniformity switching ray.
My point is that it’s not clear to me that it’s a mistake to elide over the distinction between moral values and aesthetic preferences. Maybe calling all of these things “preferences” is instead an excellent way of introducing the fortunate connotation that the degree to which any of them matter is equally arbitrary and situational, however intense the feeling that some preferences are “moral values” or “terminal values” or whatever other privileged term we want to apply to them.
These are two different people, many objections from the fact they disagree one ought to have from the fact that one and some random other contemporary person disagree.
And yet, a lot of our culture presumes that there are important differences between the two.
E.g., culturally we think it’s reasonable for someone at 20 to make commitments that are binding on that person at 40, whereas we think it’s really strange for someone at 20 or 40 to make commitments that are binding on some random other contemporary person.
Ah, sexual preference was a poor example in general– in my case, being single at the moment means I wouldn’t be injuring anybody if my preferences changed. Were I in a serious relationship, I’d flee from the ray gun too.
Thanks for this clarification.
I personally don’t get that connotation from the term “preferences,” but I’m sure others do.
Anyway, so… Eliezer distinguishes prudential oughts from moral oughts by saying that moral oughts are what we ought to do to satisfy some small subset of our preferences: preferences that we wouldn’t want changed by an alien ray gun? I thought he was saying that I morally should_Luke do what will best satisfy a global consideration of my preferences.
No, no, no- I don’t mean that what I pointed out was the only distinction or the fundamental distinction, just that there’s a big honking difference in at least one salient way. I’m not speaking for Eliezer on what’s the best way to carve up that cluster in concept-space.
Oh. Well, what do you think Eliezer has tried to say about how to carve up that cluster in concept-space?