I think there’s an existing phrase called “defense in depth”, which somehow feels… more like the right spirit? [This is related to the ‘swiss cheese’ model you bring up in the motivation section.] It’s not that we’re going to throw together a bunch of miscellaneous stuff and it’ll work; it’s that we’re not going to trust any particular defense that we have enough that we don’t also want other defenses.
I think there’s an existing phrase called “defense in depth”, which somehow feels… more like the right spirit? [This is related to the ‘swiss cheese’ model you bring up in the motivation section.] It’s not that we’re going to throw together a bunch of miscellaneous stuff and it’ll work; it’s that we’re not going to trust any particular defense that we have enough that we don’t also want other defenses.
Or what Yudkowsky calls “security mindset”, he insists so much on this on Arbital, on deploying all the options.