Would it be worth asking them what their personal fire alarm would be, or what they are confident will not be achieved in the next N years?
If you ask about what would constitute a fire alarm for AGI, it might be useful to also ask how much advance warning the thing they come up with would give.
If you ask about what would constitute a fire alarm for AGI, it might be useful to also ask how much advance warning the thing they come up with would give.