Evolution actually solved alignment (approximately) on two levels: aligning brains with evolution’s goal of inclusive genetic fitness—to be fruitful and multiply - (even though the easy/natural goal attractor for intelligence is empowerment), and aligning brains with other brains because the unit of selection (genes) is spread across individual bodies (the disposable soma). There are many obvious failure examples, but that’s hardly surprising because evolution proceeds by breaking things.
The first type of alignment (towards genetic fitness) gives rise to lust, sexual attraction, parenting desires, etc. The second form of alignment (to other humans) - more relevant for AGI—manifests as empathy, love, and altruism.
Evolution actually solved alignment (approximately) on two levels: aligning brains with evolution’s goal of inclusive genetic fitness—to be fruitful and multiply - (even though the easy/natural goal attractor for intelligence is empowerment), and aligning brains with other brains because the unit of selection (genes) is spread across individual bodies (the disposable soma). There are many obvious failure examples, but that’s hardly surprising because evolution proceeds by breaking things.
The first type of alignment (towards genetic fitness) gives rise to lust, sexual attraction, parenting desires, etc. The second form of alignment (to other humans) - more relevant for AGI—manifests as empathy, love, and altruism.