A few other possible terms to add to the brainstorm:
AI massive catastrophic risks
AI global catastrophic risks
AI catastrophic misalignment risks
AI catastrophic accident risks (paired with “AI catastrophic misuse risks”)
AI weapons of mass destruction (WMDs) - Pro: a well-known term, Con: strongly connotes misuse so may be useful for that category but probably confusing to try and use for misalignment risks
A few other possible terms to add to the brainstorm:
AI massive catastrophic risks
AI global catastrophic risks
AI catastrophic misalignment risks
AI catastrophic accident risks (paired with “AI catastrophic misuse risks”)
AI weapons of mass destruction (WMDs) - Pro: a well-known term, Con: strongly connotes misuse so may be useful for that category but probably confusing to try and use for misalignment risks