I think that Phil was talking about what Americans in general would say that they want from an AI. It should go without saying that what they would say would reveal fundamental misunderstandings of what they were talking about.
There is a distinction between normative “what these people should choose” and descriptive “what would be these people’s (uninformed) choice”. I suspect Phil is taking both to give the same result in this post. (Phil?)
Neither of those alternatives makes any sense to me. An uninformed choice would be a random choice. What they “should” choose sounds like what they would choose if they were much better reasoners than they are.
What sense did you mean to describe Democrats/libertarians/etc. choice about a singleton? Actual informed choice? Does this choice disagree with what you think they should choose (in the sense of what they would choose if they were smarter and more informed than they can ever actually be, but with the same values, which are not necessarily equal to yours)?
An uninformed choice would be a random choice.
Nothing is random in this sense. A choice made with limited ability to reason, even if “informed”, still involves a fair amount of noise. Not being reliably informed of what the question actually means is but a grade of the same problem. Thus, I meant “uniformed choice” in the sense of not being reliably the correct choice, for one reason or another.
I think that Phil was talking about what Americans in general would say that they want from an AI. It should go without saying that what they would say would reveal fundamental misunderstandings of what they were talking about.
It seems not.
On the contrary, it would seem so.
There is a distinction between normative “what these people should choose” and descriptive “what would be these people’s (uninformed) choice”. I suspect Phil is taking both to give the same result in this post. (Phil?)
Neither of those alternatives makes any sense to me. An uninformed choice would be a random choice. What they “should” choose sounds like what they would choose if they were much better reasoners than they are.
What sense did you mean to describe Democrats/libertarians/etc. choice about a singleton? Actual informed choice? Does this choice disagree with what you think they should choose (in the sense of what they would choose if they were smarter and more informed than they can ever actually be, but with the same values, which are not necessarily equal to yours)?
Nothing is random in this sense. A choice made with limited ability to reason, even if “informed”, still involves a fair amount of noise. Not being reliably informed of what the question actually means is but a grade of the same problem. Thus, I meant “uniformed choice” in the sense of not being reliably the correct choice, for one reason or another.