Upvoted for this comment, which hints at a lot of fun ideas:
Objection: What about social progress? Cultural values change over time, and only taking into account the preferences of people alive now would force cultural values to stagnate.
Answer: To the extent that you want cultural values to be able to drift, this will be included in your utility function.
Upvoted for this comment, which hints at a lot of fun ideas: