Humans have never completed at large scale engineering task without at least one mistake
This line does not seem sufficiently well-defined.
Both “launch a satellite” and “launch the specific satellite” are large scale engineering tasks (or were, in the previous century); the first one had some mistakes, and in most cases the second one had no mistakes.
Transferring the argument to AI: the mistake may happen and be fixed while the task is not “create aligned AGI” but some prerequisite one, so it doesn’t ensure that the final AGI is unaligned.
OK I take your point. In your opinion would this be an improvement “Humans have never completed at large scale engineering task without at least one mistake on the first attempt”?
For the argument with AI, will the process that is used to make current AI scale to AGI level? From what I understand that is not the case. Is that predicted to change?
This line does not seem sufficiently well-defined.
Both “launch a satellite” and “launch the specific satellite” are large scale engineering tasks (or were, in the previous century); the first one had some mistakes, and in most cases the second one had no mistakes.
Transferring the argument to AI: the mistake may happen and be fixed while the task is not “create aligned AGI” but some prerequisite one, so it doesn’t ensure that the final AGI is unaligned.
OK I take your point. In your opinion would this be an improvement “Humans have never completed at large scale engineering task without at least one mistake on the first attempt”?
For the argument with AI, will the process that is used to make current AI scale to AGI level? From what I understand that is not the case. Is that predicted to change?
Thank you for giving feedback.