I read that story. I guess I was confused by the ending in which an entire populated star system was destroyed to prevent everyone having their utility function changed.
I guess he might be referring to the Superhappies’ self-modification? I don’t know, I’m still struggling to understand how someone could read “True Ending: Sacrificial Fire” and think Bad End.
That’s what happens when you take “thou shalt not modify thine own utility function” as a religious tenet.
Wrong, the “religious tenet” is not “thou shalt not modify thine own utility function”, but “minimize evil”. Of course, being changed to no longer care about minimizing evil is not conducive to minimizing evil.
I read that story. I guess I was confused by the ending in which an entire populated star system was destroyed to prevent everyone having their utility function changed.
I guess he might be referring to the Superhappies’ self-modification? I don’t know, I’m still struggling to understand how someone could read “True Ending: Sacrificial Fire” and think Bad End.
That’s what happens when you take “thou shalt not modify thine own utility function” as a religious tenet.
Wrong, the “religious tenet” is not “thou shalt not modify thine own utility function”, but “minimize evil”. Of course, being changed to no longer care about minimizing evil is not conducive to minimizing evil.