Good illustrative post, we all need to be more wary of “bad memes that nevertheless flatter the rationalist/EA/LW ingroup, even if it’s in a subtle/culturally-contingent way”. For every “invest in crypto early”, there’s at least one fad diet.
I’m definitely thinking more about attack surfaces and exploitative third parties here, rather than bad memes being generated internally (sorry to be vague about this, it’s a public post).
But also a big crux here is that the attack surface is defined by the ability to brute force stuff that fits perfectly into a hole in the heart of the human mind (or fits perfectly into a hole in the heart of a larger group or society), and specific examples like flattery are helpful.
Good illustrative post, we all need to be more wary of “bad memes that nevertheless flatter the rationalist/EA/LW ingroup, even if it’s in a subtle/culturally-contingent way”. For every “invest in crypto early”, there’s at least one fad diet.
I’m definitely thinking more about attack surfaces and exploitative third parties here, rather than bad memes being generated internally (sorry to be vague about this, it’s a public post).
But also a big crux here is that the attack surface is defined by the ability to brute force stuff that fits perfectly into a hole in the heart of the human mind (or fits perfectly into a hole in the heart of a larger group or society), and specific examples like flattery are helpful.