Leafcraft comments on Less Realistic Tales of Doom

[Leafcraft]

Ah, good point! I have a feeling this is a central issue that is hardly discussed here (or anywhere)

[Sam Clarke]

Will MacAskill calls this the “actual alignment problem”

Wei Dai has written a lot about related concerns in posts like The Argument from Philosophical Difficulty