Maybe “don’t advertise too hard that one should optimize for what they believe is good, because someone crazy will hear you and get radicalized by the message”. (such as Zizians)
Many people seem to have an instinct to translate “work hard” as “do some crazy violent action”. Just a few days ago, someone on ACX asked: “if you believe that AI is harmful, why don’t you support a terrorist group to kill the AI researchers?” For a certain mindset, this is the obvious logical response to feeling strongly about something: if you are not murdering people left and right, it means you don’t care enough about your cause.
I guess there is an evolutionary reason for this: we are running on a corruptedhardware. In our evolutionary past, successfully organizing senseless violence could be an efficient way to get to the top of the tribe, so we are tempted by instinct to propose it as a solution for various problems.
The question is, how to communicate the message so that it arrives to people who are likely to translate “work hard” as becoming stronger, learning about how stuff works, designing a solution, and testing it; but it somehow does not arrive to people who are likely to translate it as “hurt everyone who disagrees”.
Can this be summarized as “don’t optimize for what you believe is good too hard, as you might be mistaken about what is good”?
Maybe “don’t advertise too hard that one should optimize for what they believe is good, because someone crazy will hear you and get radicalized by the message”. (such as Zizians)
Many people seem to have an instinct to translate “work hard” as “do some crazy violent action”. Just a few days ago, someone on ACX asked: “if you believe that AI is harmful, why don’t you support a terrorist group to kill the AI researchers?” For a certain mindset, this is the obvious logical response to feeling strongly about something: if you are not murdering people left and right, it means you don’t care enough about your cause.
I guess there is an evolutionary reason for this: we are running on a corrupted hardware. In our evolutionary past, successfully organizing senseless violence could be an efficient way to get to the top of the tribe, so we are tempted by instinct to propose it as a solution for various problems.
The question is, how to communicate the message so that it arrives to people who are likely to translate “work hard” as becoming stronger, learning about how stuff works, designing a solution, and testing it; but it somehow does not arrive to people who are likely to translate it as “hurt everyone who disagrees”.