Ask the general public if, for example, they’d prefer a personal AI that “whistleblows” on them if they ever lie, or cheat on their girlfriends/wives, or break any law, to one that’s aligned to their interests/will.
An analogy I like is a car that reports you to the traffic cops if your parking meter runs out for Safety reasons.
Haldane said it well: