So AI papers are currently good enough that they can’t be trivially distinguished from human papers, making Pangram necessary, but not yet good enough to produce AI research that is at least on a human level. From the outside this looks like a sign that RSI fairly close now.
Tangentially, it’s somewhat interesting that Pangram is a twist on Turing’s original test: In the original, it was a human who had to distinguish between a human and an AI based on text, now it is an AI that distinguishes between both, since AIs are apparently better now than humans in distinguishing between humans and AIs. So Pangram is a CAPTCHA, but conventional captchas weren’t better than humans at distinguishing between AIs and humans.
So AI papers are currently good enough that they can’t be trivially distinguished from human papers, making Pangram necessary, but not yet good enough to produce AI research that is at least on a human level. From the outside this looks like a sign that RSI fairly close now.
Tangentially, it’s somewhat interesting that Pangram is a twist on Turing’s original test: In the original, it was a human who had to distinguish between a human and an AI based on text, now it is an AI that distinguishes between both, since AIs are apparently better now than humans in distinguishing between humans and AIs. So Pangram is a CAPTCHA, but conventional captchas weren’t better than humans at distinguishing between AIs and humans.