One of the most important decisions in war is when to stop. Humans evolved fear to solve this problem; there’s a point at which soldiers will de-escalate the conflict (i.e. flee the battlefield rather than stay and die). However, signalling fear makes you a target so people don’t discuss it candidly. I am concerned that military leaders may, in the calm of the office, design AI that has no provisions for de-escalating conflict; this seems very likely to lead to nuclear war.
One of the most important decisions in war is when to stop. Humans evolved fear to solve this problem; there’s a point at which soldiers will de-escalate the conflict (i.e. flee the battlefield rather than stay and die). However, signalling fear makes you a target so people don’t discuss it candidly. I am concerned that military leaders may, in the calm of the office, design AI that has no provisions for de-escalating conflict; this seems very likely to lead to nuclear war.