I really like this thinking… I might write a top level post inspired by this thread but some notes:
“can lead to polarization” hides some important complexity. Which memes lead to polarization? Do some memes do it less? Do some lead to unification? Can we measure that? If we could find and deploy memes that lead both to more correct thinking about AGI and to healing political divides that would be peachy.
Not all memes are phrases. Not all memes are in words. What are the other memes and how much should we be paying attention to their effects and how to effect them?
There are specific people we want to influence, specifically, the people causing AGI to happen. They exist in a complex social structure influenced by political and market structures which are in turn influenced by other more general populations. So a meme being successful with specific groups may be more important than it’s success with others. Unfortunately, this is a very complicated thing to try to understand or influence.
Related to asymetric weapons, we would ideally not be engaging in memetic warfare but instead finding ways to end memetic warfare and heal mass discourse… but it should be noted that that is an ambitious goal outside of ensuring AI does not kill everyone, and so a (careful) forked approach is probably desirable.
Edit: Additionally, inspired by Richard_Ngo’s comment, thought should probably be given to attacks on correct AGI thinking and proactively promoting memes which defend against them.
I really like this thinking… I might write a top level post inspired by this thread but some notes:
“can lead to polarization” hides some important complexity. Which memes lead to polarization? Do some memes do it less? Do some lead to unification? Can we measure that? If we could find and deploy memes that lead both to more correct thinking about AGI and to healing political divides that would be peachy.
Not all memes are phrases. Not all memes are in words. What are the other memes and how much should we be paying attention to their effects and how to effect them?
There are specific people we want to influence, specifically, the people causing AGI to happen. They exist in a complex social structure influenced by political and market structures which are in turn influenced by other more general populations. So a meme being successful with specific groups may be more important than it’s success with others. Unfortunately, this is a very complicated thing to try to understand or influence.
Related to asymetric weapons, we would ideally not be engaging in memetic warfare but instead finding ways to end memetic warfare and heal mass discourse… but it should be noted that that is an ambitious goal outside of ensuring AI does not kill everyone, and so a (careful) forked approach is probably desirable.
Edit: Additionally, inspired by Richard_Ngo’s comment, thought should probably be given to attacks on correct AGI thinking and proactively promoting memes which defend against them.