One version of a good-ish trajectory I imagine has something like a step 1.b to defuse the catastrophic misuse problem, which involves sufficient foresight and exploratory engineering to anticipate particularly disruptive or destructive prospects, and 2.a, checking in on development projects to make sure they’re either foreclosing those or delayed enough to 2.b, develop countermeasures in the mean time.
Failure modes also left as an exercise to the reader.
One version of a good-ish trajectory I imagine has something like a step 1.b to defuse the catastrophic misuse problem, which involves sufficient foresight and exploratory engineering to anticipate particularly disruptive or destructive prospects, and 2.a, checking in on development projects to make sure they’re either foreclosing those or delayed enough to 2.b, develop countermeasures in the mean time.
Failure modes also left as an exercise to the reader.