Question, are you assuming time travel or acausality being a thing in the next 20-30 years due to FTL work? Because that’s the only way that time from AGI understanding to superintelligence is negative at all.
No, I expect (absent agent foundations advances) people will build superintelligence before they understand the basic shape of things of which that AGI will consist. An illustrative example (though I don’t think this exact thing will happen): if the first superintelligence popped out of a genetic algorithm, then people would probably have no idea what pieces went into the thing by the time it exists.
Wow. It seems to me that the fact that you didn’t even imagine what John had in mind somehow implies really a lot about how your model differs from his (and mine).
Question, are you assuming time travel or acausality being a thing in the next 20-30 years due to FTL work? Because that’s the only way that time from AGI understanding to superintelligence is negative at all.
No, I expect (absent agent foundations advances) people will build superintelligence before they understand the basic shape of things of which that AGI will consist. An illustrative example (though I don’t think this exact thing will happen): if the first superintelligence popped out of a genetic algorithm, then people would probably have no idea what pieces went into the thing by the time it exists.
Wow. It seems to me that the fact that you didn’t even imagine what John had in mind somehow implies really a lot about how your model differs from his (and mine).