I think alignment is still important and net-positive, but yeah I’ve come to think it’s no longer the number 1 priority, for the reasons you raise.
I think with the exception of biotech and nanotech, no plausible technology in the physical world can actually become a recipe for ruin, unless we are deeply wrong about how the physical laws of the universe work, so we can just defer that question to AI superintelligences.
Edited to remove the nanotech arguments, as I no longer think they’re relevant.
I think my 2 biggest disagreements are:
I think alignment is still important and net-positive, but yeah I’ve come to think it’s no longer the number 1 priority, for the reasons you raise.
I think with the exception of biotech and nanotech, no plausible technology in the physical world can actually become a recipe for ruin, unless we are deeply wrong about how the physical laws of the universe work, so we can just defer that question to AI superintelligences.
Edited to remove the nanotech arguments, as I no longer think they’re relevant.