I guess that comes down to whether a future AI can predict or control future innovations of itself indefinitely.
That’s a key question. You might be interested in this section on limits of controllability.
Clarifying questions: 1. To what extent can AI predict the code they will learn from future unknown inputs, and how that code will subsequently interact with then connected surroundings of the environment?
2. To what extent can AI predict all the (microscopic) modifications that will result from all the future processes involved in the future re-production of hardware components?
That’s a key question. You might be interested in this section on limits of controllability.
Clarifying questions:
1. To what extent can AI predict the code they will learn from future unknown inputs, and how that code will subsequently interact with then connected surroundings of the environment?
2. To what extent can AI predict all the (microscopic) modifications that will result from all the future processes involved in the future re-production of hardware components?