I don’t remember the would_want semantics anywhere in EY’s writings
It was in a past conversation on the subject of what Eliezer means by “should” and related terms. That was the answer he gave in response to the explicit question. In actual writings there hasn’t been a particular need to refer concisely to the morality of other agents independently of their actual preferences. When describing Baby Eaters, for example, natural language worked just fine.
It was in a past conversation on the subject of what Eliezer means by “should” and related terms. That was the answer he gave in response to the explicit question. In actual writings there hasn’t been a particular need to refer concisely to the morality of other agents independently of their actual preferences. When describing Baby Eaters, for example, natural language worked just fine.