All of the plans I know of for aligning superintelligence are timeline-sensitive, either because they involve research strategies that haven’t paid off yet, or because they involve using non-superintelligent AI to help with alignment of subsequent AIs. Acceleration specifically in the supply of compute makes all those plans harder. If you buy the argument that misaligned superintelligence is a risk at all, Stargate is a bad thing.
The one silver lining is that this is all legible. The current administration’s stance seems to be that we should build AI quickly in order to outrace China; the previous administration’s stance was to say that the real existential risk is minorities being denied on loan applications. I prefer the “race with China” position because at least there exists a set of factual beliefs that would make that correct, implying it may be possible to course-correct when additional information becomes available.
All of the plans I know of for aligning superintelligence are timeline-sensitive, either because they involve research strategies that haven’t paid off yet, or because they involve using non-superintelligent AI to help with alignment of subsequent AIs. Acceleration specifically in the supply of compute makes all those plans harder. If you buy the argument that misaligned superintelligence is a risk at all, Stargate is a bad thing.
The one silver lining is that this is all legible. The current administration’s stance seems to be that we should build AI quickly in order to outrace China; the previous administration’s stance was to say that the real existential risk is minorities being denied on loan applications. I prefer the “race with China” position because at least there exists a set of factual beliefs that would make that correct, implying it may be possible to course-correct when additional information becomes available.