In response to common objection (1), the AI is much smarter than us --
I think there’s a fairly high probability that we get an AGI which is eventually much smarter than us, but passes through earlier stages where it isn’t. From a “defense in depth” perspective, we should be keeping and preparing to use the strategies that only work on weaker AGIs, just not relying on them too heavily.
In response to common objection (1), the AI is much smarter than us --
I think there’s a fairly high probability that we get an AGI which is eventually much smarter than us, but passes through earlier stages where it isn’t. From a “defense in depth” perspective, we should be keeping and preparing to use the strategies that only work on weaker AGIs, just not relying on them too heavily.