Undergraduate student in math and computer science at McGill and Mila. I am interested in artificial general intelligence. Optimizing for the flourishing of all sentient life regardless of substrate.
george_adams
Karma: 19
Undergraduate student in math and computer science at McGill and Mila. I am interested in artificial general intelligence. Optimizing for the flourishing of all sentient life regardless of substrate.
I agree with most things said but not with the conclusion. There is a massive chunk of human (typically male) psyche that will risk death/major consequences in exchange for increasing social status. Think of basically any war. A specific example is Kamikazee pilots in WW2 who flew in suicide missions for the good of the nation. The pilots were operating within a value system that rewarded individual sacrifice for the greater mission. The creators of AGI will have increasing social status (and competition, thanks to Moloch) until the point of AGI ruin.
(Also minor point that some accelerationists are proudly anti speciest and don’t care about the wellbeing of humans)