Another issue with “AI notkilleveryoneism” is that it is most easily accomplished by never building AI.
Maximizing strictly against that utility function means that we are guaranteed to never build AI, because however low the risk from AI may be, the risk from AI involved in not building AI is lower. (And at least some people around here have said things to the effect of “yeah, our world just shouldn’t ever build AI, we cannot handle it.”)
If you think that a world where AI is never built sucks compared to one where it is built and makes the world better, and that the later is possible, it would make sense to object to the terminology for that reason—it would make sense to be reluctant to join a movement beneath that banner.
Another issue with “AI notkilleveryoneism” is that it is most easily accomplished by never building AI.
Maximizing strictly against that utility function means that we are guaranteed to never build AI, because however low the risk from AI may be, the risk from AI involved in not building AI is lower. (And at least some people around here have said things to the effect of “yeah, our world just shouldn’t ever build AI, we cannot handle it.”)
If you think that a world where AI is never built sucks compared to one where it is built and makes the world better, and that the later is possible, it would make sense to object to the terminology for that reason—it would make sense to be reluctant to join a movement beneath that banner.
utopia notkilleveryoneism
there I fixed it