There are infinitely many distributions from which the training data of GPT could have been sampled from [EDIT: including ones that could be catastrophic as the distribution our AGI learns], so it’s worth mentioning an additional challenge on this route: making the future AGI-level-GPT learn the “human writing distribution” that we have in mind.
There are infinitely many distributions from which the training data of GPT could have been sampled from [EDIT: including ones that could be catastrophic as the distribution our AGI learns], so it’s worth mentioning an additional challenge on this route: making the future AGI-level-GPT learn the “human writing distribution” that we have in mind.