It recently occurred to me that humans’ apparent tendency to seek status could emerge without any optimization for such, conscious or subconscious, being built-in to the brain at all. Instead, it could be an emergent consequence of our tendency to preferentially attend to and imitate certain people over others. According to The Secret of Our Success, such imitation can extend down to very low-level patterns of behavior, such as what foods we enjoy eating. So you could imagine peoples’ behavior and personalities being determined by a sort of ‘attentional darwinism’: patterns of behavior that tend to get paid attention to and imitated will become common in the population, while those that do not will dwindle. The end result of this will be that an average person’s personality will look approximately like a imitation-optimizer—aka status-seeker—just like an average organism will look approximately like a fitness optimizer. This would make humans doubly mesa-optimizers, both of status-evolution and gene-evolution. This suggests that extracting a CEV of all humanity might be hard, since many of our terminal values could be local to our particular culture’s status-evolution.
It recently occurred to me that humans’ apparent tendency to seek status could emerge without any optimization for such, conscious or subconscious, being built-in to the brain at all. Instead, it could be an emergent consequence of our tendency to preferentially attend to and imitate certain people over others. According to The Secret of Our Success, such imitation can extend down to very low-level patterns of behavior, such as what foods we enjoy eating. So you could imagine peoples’ behavior and personalities being determined by a sort of ‘attentional darwinism’: patterns of behavior that tend to get paid attention to and imitated will become common in the population, while those that do not will dwindle. The end result of this will be that an average person’s personality will look approximately like a imitation-optimizer—aka status-seeker—just like an average organism will look approximately like a fitness optimizer. This would make humans doubly mesa-optimizers, both of status-evolution and gene-evolution. This suggests that extracting a CEV of all humanity might be hard, since many of our terminal values could be local to our particular culture’s status-evolution.