If I read that term [“AI existential safety”] without a definition I would assume it meant “reducing the existential risk posed by AI.” Hopefully you’d be OK with that reading. I’m not sure if you are trying to subtly distinguish it from Nick’s definition of existential risk or if the definition you give is just intended to be somewhere in that space of what people mean when they say “existential risk” (e.g. the LW definition is like yours).
Yep, that’s my intention. If given the chance I’d also shift the meaning of “existential risk” a bit away from Bostrom’s and a bit toward a more naive meaning of the term, but that’s a separate objective :) Specifically, if I got to rewrite Nick’s terminology (which might be too late now that it’s on Wikipedia), I’d say “existential risk” should mean “risk to the existence of humanity” and “existential-level risk” should mean “risks that are as morally significant as risks to the existence of humanity” (which, roughly speaking, is what Bostrom currently calls “existential risk”).
Good to hear!
Yep, that’s my intention. If given the chance I’d also shift the meaning of “existential risk” a bit away from Bostrom’s and a bit toward a more naive meaning of the term, but that’s a separate objective :) Specifically, if I got to rewrite Nick’s terminology (which might be too late now that it’s on Wikipedia), I’d say “existential risk” should mean “risk to the existence of humanity” and “existential-level risk” should mean “risks that are as morally significant as risks to the existence of humanity” (which, roughly speaking, is what Bostrom currently calls “existential risk”).