You’re right, but creating unexpected new knowledge is not a PhD requirement. I expect it’s pretty rare that a PhD students achieves that level of research.
I do weakly expect it to be necessary to reach AGI though. Also, I personally wouldn’t want to do a PhD that didn’t achieve this!
It wasn’t a great explanation, sorry, and there are definitely some leaps, digressions, and hand-wavy bits. But basically: Even if current AI research were all blind mutation and selection, we already know that that can yield general intelligence from animal-level-intelligence because evolution did it. And we already have various examples of how human research can apply much greater random and non-random mutation, larger individual changes, higher selection pressure in a preferred direction, and more horizontal transfer of traits than evolution can, enabling (very roughly estimated) ~3-5 OOMs greater progress per generation with fewer individuals and shorter generation times.
Okay, then I understand the intuition but I think it needs a more rigorous analysis to even make an educated guess either way.
I do weakly expect it to be necessary to reach AGI though. Also, I personally wouldn’t want to do a PhD that didn’t achieve this!
Okay, then I understand the intuition but I think it needs a more rigorous analysis to even make an educated guess either way.
No, thank you!
Agreed. It was somewhere around reason #4 I quit my PhD program as soon as I qualified for a masters in passing.