No, because people are not completely rational. What I ‘really’ want to do is what I would do if I were fully informed, rational, etc. Morality is difficult because our brains do not just tell us what we want. Demonstrated preference would only work with ideal agents, and even then it could only tell you what they want most among the possible options.
Is this basically saying that you can tell someone else’s utility function by demonstrated preference? It sounds a lot like that.
No, because people are not completely rational. What I ‘really’ want to do is what I would do if I were fully informed, rational, etc. Morality is difficult because our brains do not just tell us what we want. Demonstrated preference would only work with ideal agents, and even then it could only tell you what they want most among the possible options.