Fwiw I do just straightforwardly agree that “they might be slightly nice, and it’s really cheap” is a fine reason to disagree with the literal title. I have some odds on this, and a lot of model uncertainty about this.
The argument that “humans wouldn’t actually preserve the environment” misses the relevant analogy which is more like “humans come across some intelligent aliens who say they want to be left alone and leaving these aliens alone is pretty cheap from our perspective, but these aliens aren’t totally optimized from our perspective, e.g. they have more suffering than we’d like in their lives”. This situation wouldn’t result in us doing something to the aliens that they consider as bad as killing them all, so the type of kindness humans have is actually sufficient.
A thing that is cruxy to me here is that the sort of thing real life humans have done is get countries addicted to opium so they can control their economy, wipe out large swaths of a population while relocating the survivors to reservations, carving up a continent for the purposes of a technologicaly powerful coalition, etc.
Superintelligences would be smarter that Europeans and have an easier time doing things we’d consider moral, but I also think Europeans would be dramatically nicer than AIs.
I can imagine the “it’s just sooooo cheap, tho” argument winning out. I’m not saying these considerations add up to “it’s crazy to think think they’d be slightly nice.” But, it doesn’t feel very likely to me.
Fwiw I do just straightforwardly agree that “they might be slightly nice, and it’s really cheap” is a fine reason to disagree with the literal title. I have some odds on this, and a lot of model uncertainty about this.
A thing that is cruxy to me here is that the sort of thing real life humans have done is get countries addicted to opium so they can control their economy, wipe out large swaths of a population while relocating the survivors to reservations, carving up a continent for the purposes of a technologicaly powerful coalition, etc.
Superintelligences would be smarter that Europeans and have an easier time doing things we’d consider moral, but I also think Europeans would be dramatically nicer than AIs.
I can imagine the “it’s just sooooo cheap, tho” argument winning out. I’m not saying these considerations add up to “it’s crazy to think think they’d be slightly nice.” But, it doesn’t feel very likely to me.