… without the help of an AI that is strong enough to significantly augment the proof research. which we have or nearly have now (may still be a little ways out, but no longer inconceivable). this seems like very much not a dead end, and is the sort of thing I’d expect even an AGI to think necessary in order to solve ASI alignment-to-that-AGI.
exactly what to prove might end up looking a bit different, of course.
this was never going to work...
… without the help of an AI that is strong enough to significantly augment the proof research. which we have or nearly have now (may still be a little ways out, but no longer inconceivable). this seems like very much not a dead end, and is the sort of thing I’d expect even an AGI to think necessary in order to solve ASI alignment-to-that-AGI.
exactly what to prove might end up looking a bit different, of course.
Why do you think it was never going to work? Even if you think humans aren’t smart enough, intelligence enhancement seems pretty likely.