Gary Marcus:BREAKING, Hysterical News: Half of the Astra problems can be solved [by] Fable. OpenAI didn’t even have a control group. And most of you fell for it!
OpenAI’s PR department suckered you AGAIN
[Emojis deleted, because they format horribly]
What a strange comment. Sure, Astra is a smaller improvement than previously thought (yesterday), but that’s because other models are more capable, not because Astra is less. The unreleased-frontier capabilities are exactly what we thought they were based on those ten findings.
Also, the observation of Fable being able to solve half of Astra’s 10 problems is consistent with the possibility that there is a different list of 10 problems that Fable can solve, such that Astra can only solve half of them.
[Emojis deleted, because they format horribly]
What a strange comment. Sure, Astra is a smaller improvement than previously thought (yesterday), but that’s because other models are more capable, not because Astra is less. The unreleased-frontier capabilities are exactly what we thought they were based on those ten findings.
Also, the observation of Fable being able to solve half of Astra’s 10 problems is consistent with the possibility that there is a different list of 10 problems that Fable can solve, such that Astra can only solve half of them.