At the end of the day it has to work. And you need scale. Someone has to pay for larger scale research.
The best way to achieve the understanding you seek is to first expand the AI industry to hundreds of thousands of people and a trillion in annual r&d and everything has a tpu in it.
Note that historically things like a detailed understanding of aerodynamics were achieved many decades after exploitation. The original aviation pioneers were dead when humans built large enough computers to model aerodynamics. Humans had already built millions of aircraft and optimized to the sr-71.
At the end of the day it has to work. And you need scale. Someone has to pay for larger scale research.
The best way to achieve the understanding you seek is to first expand the AI industry to hundreds of thousands of people and a trillion in annual r&d and everything has a tpu in it.
Note that historically things like a detailed understanding of aerodynamics were achieved many decades after exploitation. The original aviation pioneers were dead when humans built large enough computers to model aerodynamics. Humans had already built millions of aircraft and optimized to the sr-71.