Thanks for your comment! First I was like, “Clippy wouldn’t formalize humans as having utility functions”, then I was like “in that case why do we want to formalize our utility functions?”, and then I was all “because we have moral intuitions saying we should follow utility functions!” It’s funny how the whole house of cards comes tumbling down.
It’s still conceivable that, even given all our shared intuitions, our “utility function” is just as underdefined as Clippy’s.
I would have said far more so.
I wonder what Clippy would infer about our utility functions.
That they’re stupid and reflectively inconsistent.
Thanks for your comment! First I was like, “Clippy wouldn’t formalize humans as having utility functions”, then I was like “in that case why do we want to formalize our utility functions?”, and then I was all “because we have moral intuitions saying we should follow utility functions!” It’s funny how the whole house of cards comes tumbling down.