[[Tangent: I am also of the perspective that we are already FOOMing, via human+bot collaborations… what else can you call it, when we & narrow AI together are able to speed Matrix Multiplication, of all things! Sweet Lord, any CS major in 2015 would have called that FOOMing… and we are already doing it, using ‘dumb’ narrow AI, and we are stumbling forward barely conscious of what’s next! Essentially, “AGI was created accidentally, when we drunkenly FOOMed so hard that capabilities came out...” No sane person was predicting how to find trimmed networks using the Lottery Ticket Hypothesis, so perhaps No-Sane Person will be right, again!]]
The researchers let PaLM parse, prompt, and filter its own outputs, to get a ‘chain-of-thought’ that is a more reliable epistemic methodology for the AI to follow, compared to its own once-through assumption. I stand by my claim—“AGI soon, but narrow works better”, and “prompted, non-temporal narrow AI with frozen weights will be able to do almost everything we feel comfortable letting them do.”
[[Tangent: I am also of the perspective that we are already FOOMing, via human+bot collaborations… what else can you call it, when we & narrow AI together are able to speed Matrix Multiplication, of all things! Sweet Lord, any CS major in 2015 would have called that FOOMing… and we are already doing it, using ‘dumb’ narrow AI, and we are stumbling forward barely conscious of what’s next! Essentially, “AGI was created accidentally, when we drunkenly FOOMed so hard that capabilities came out...” No sane person was predicting how to find trimmed networks using the Lottery Ticket Hypothesis, so perhaps No-Sane Person will be right, again!]]
Well, narrow AI just FOOMed in its pants a little more: “Large Language Models can Self-Improve”
The researchers let PaLM parse, prompt, and filter its own outputs, to get a ‘chain-of-thought’ that is a more reliable epistemic methodology for the AI to follow, compared to its own once-through assumption. I stand by my claim—“AGI soon, but narrow works better”, and “prompted, non-temporal narrow AI with frozen weights will be able to do almost everything we feel comfortable letting them do.”