I’m not saying LessWrong are the only misaligned ones, although we might be more than others. I’m saying any group who wants humanity to survive is misaligned with respect to the optimization process that created that group.
Luckily, at least a little bit of this misalignment is common! I’m just pointing out that we were never optimized for this; the only reason humans care about humanity as a whole is that our society isn’t the optimum of the optimization process that created it. And it’s not random either; surviving is an instrumental value that any optimization process has to deal with when creating intelligences.
I’m not saying LessWrong are the only misaligned ones, although we might be more than others. I’m saying any group who wants humanity to survive is misaligned with respect to the optimization process that created that group.
Luckily, at least a little bit of this misalignment is common! I’m just pointing out that we were never optimized for this; the only reason humans care about humanity as a whole is that our society isn’t the optimum of the optimization process that created it. And it’s not random either; surviving is an instrumental value that any optimization process has to deal with when creating intelligences.