I personally don’t get that connotation from the term “preferences,” but I’m sure others do.
Anyway, so… Eliezer distinguishes prudential oughts from moral oughts by saying that moral oughts are what we ought to do to satisfy some small subset of our preferences: preferences that we wouldn’t want changed by an alien ray gun? I thought he was saying that I morally should_Luke do what will best satisfy a global consideration of my preferences.
No, no, no- I don’t mean that what I pointed out was the only distinction or the fundamental distinction, just that there’s a big honking difference in at least one salient way. I’m not speaking for Eliezer on what’s the best way to carve up that cluster in concept-space.
Thanks for this clarification.
I personally don’t get that connotation from the term “preferences,” but I’m sure others do.
Anyway, so… Eliezer distinguishes prudential oughts from moral oughts by saying that moral oughts are what we ought to do to satisfy some small subset of our preferences: preferences that we wouldn’t want changed by an alien ray gun? I thought he was saying that I morally should_Luke do what will best satisfy a global consideration of my preferences.
No, no, no- I don’t mean that what I pointed out was the only distinction or the fundamental distinction, just that there’s a big honking difference in at least one salient way. I’m not speaking for Eliezer on what’s the best way to carve up that cluster in concept-space.
Oh. Well, what do you think Eliezer has tried to say about how to carve up that cluster in concept-space?