I’m not talking about an acausal deal or something where the AI judges our moral system and treats us accordingly. I mean that the AI is aligned to the moral system of its powerful masters, which I think will see too little problem with tormenting us for much the same reason most people see too little problem with tormenting animals: no respect for sentients not powerful enough to enter the social contract.
Also in the limit of extreme computational power and simulation capacity, I would also start worrying about the proverbial “video game characters” of the future, too. Which is why the veganism needs to be generalized, it’s not just about animals, or even just about powerless humans or even only beings that exist right now: post-singularity you’ll be able to just tailor-make more beings for only God knows what purpose.
I’m not talking about an acausal deal or something where the AI judges our moral system and treats us accordingly. I mean that the AI is aligned to the moral system of its powerful masters, which I think will see too little problem with tormenting us for much the same reason most people see too little problem with tormenting animals: no respect for sentients not powerful enough to enter the social contract.
Also in the limit of extreme computational power and simulation capacity, I would also start worrying about the proverbial “video game characters” of the future, too. Which is why the veganism needs to be generalized, it’s not just about animals, or even just about powerless humans or even only beings that exist right now: post-singularity you’ll be able to just tailor-make more beings for only God knows what purpose.