People aren’t motivated by morality alone—people aren’t required to do what they recognize to be morally correct.
e.g. a parent may choose their kid’s life over the lives of a hundred other children. Because they care more about their own child—not because they think it’s the morally correct thing to do.
Our moral sense is only one of the many things that motivate us.
Our moral sense is only one of the many things that motivate us.
I’m talking about extrapolated morality, which is not the same thing as moral sense (i.e. judgments accessible on human level without doing much more computation). This extrapolated morality determines what should motivate you, but of course it’s not what does motivate you, and neither is non-extrapolated moral sense. In this sense it’s incorrect to oppose extrapolated morality (you shouldn’t do it), but you are in actuality motivated by other things, so you’ll probably act incorrectly (in this sense).
In what sense ‘should’ individuals be motivated by their CEV rather than by their non-CEV preferences? Wouldn’t breaking down the word ‘should’ in that previous sentence give you “Individuals want to achieve a state whereby they want to achieve what a perfect version of themselves would want to achieve rather than what they want to achieve”? Isn’t that vaguely self-defeating?
People aren’t motivated by morality alone—people aren’t required to do what they recognize to be morally correct.
e.g. a parent may choose their kid’s life over the lives of a hundred other children. Because they care more about their own child—not because they think it’s the morally correct thing to do.
Our moral sense is only one of the many things that motivate us.
I’m talking about extrapolated morality, which is not the same thing as moral sense (i.e. judgments accessible on human level without doing much more computation). This extrapolated morality determines what should motivate you, but of course it’s not what does motivate you, and neither is non-extrapolated moral sense. In this sense it’s incorrect to oppose extrapolated morality (you shouldn’t do it), but you are in actuality motivated by other things, so you’ll probably act incorrectly (in this sense).
Could you please point me in the direction of some discussion about ‘extrapolated morality’ (unless you mean CEV, in which case there’s no need)?
CEV for individuals is vaguely analogous to what I’m referring to, but I don’t know in any detail what I mean.
It’s basically CEV for individuals, yeah.
In what sense ‘should’ individuals be motivated by their CEV rather than by their non-CEV preferences? Wouldn’t breaking down the word ‘should’ in that previous sentence give you “Individuals want to achieve a state whereby they want to achieve what a perfect version of themselves would want to achieve rather than what they want to achieve”? Isn’t that vaguely self-defeating?
It’s more a useful definition of “should” than advice using a preexisting meaning for “should”.