such AI seems worse than the aliens that would otherwise claim a large fraction of the lightcone.
Any moral intuitions for why so? It seems to me that alien civilisations could also suffer loss of control or gradual disempowerment to AI, or any spectrum of scenarios between these and retaining ‘agency’ whatever that means. Do biologically evolved lifeforms definitely have positive moral valence?
Any moral intuitions for why so? It seems to me that alien civilisations could also suffer loss of control or gradual disempowerment to AI, or any spectrum of scenarios between these and retaining ‘agency’ whatever that means. Do biologically evolved lifeforms definitely have positive moral valence?