The “how to think” memes floating around, the cached thoughts of Deep Wisdom—some of it will be good advice devised by rationalists. But other notions were invented to protect a lie or self-deception: spawned from the Dark Side.
It’s so unfortunate that “how to think”—the rules of proper belief—are not hardcoded in the system’s firmware, and must instead be entered via user-supplied data the belief system is built to manage. I’d frame that this post is centrally about this user-caused systembehavior-variability, and the implicit security flaw.
Another aspect: Dominant memes—that is, memes that feel good, fair & highstatus—can be functionally dysvirtuous and unilaterally damaging.
It’s so unfortunate that “how to think”—the rules of proper belief—are not hardcoded in the system’s firmware, and must instead be entered via user-supplied data the belief system is built to manage. I’d frame that this post is centrally about this user-caused systembehavior-variability, and the implicit security flaw.
Another aspect: Dominant memes—that is, memes that feel good, fair & highstatus—can be functionally dysvirtuous and unilaterally damaging.