We are Friendlier than a paperclip maximizer, but we’re not just-plain-Friendly. We can be led to do nasty things for all kinds of reasons in all kinds of ways, we are subject to goal distortion and various interfering biases even insofar as our goals are correct, and our goals aren’t fully transparent to us to allow explicit unambiguous pursuit anyway.
I think most of us are Friendly “enough”, but those who aren’t tend to have a disproportionate impact on world history (Hitler would be one of the most extreme examples).
We are Friendlier than a paperclip maximizer, but we’re not just-plain-Friendly. We can be led to do nasty things for all kinds of reasons in all kinds of ways, we are subject to goal distortion and various interfering biases even insofar as our goals are correct, and our goals aren’t fully transparent to us to allow explicit unambiguous pursuit anyway.
I think most of us are Friendly “enough”, but those who aren’t tend to have a disproportionate impact on world history (Hitler would be one of the most extreme examples).