OK. Yeah that’s also my opinion too. Maybe I am one of the people leaning too heavily on their work. The problem is, there isn’t much else to go on. “The worst benchmark for predicting AGI, except for all the others.”
Fwiw I think the AI village is at least as good of a benchmark for predicting AGI! Of course it’s harder to quantify progress in the village, but it’s very helpful for developing intuitions.
OK. Yeah that’s also my opinion too. Maybe I am one of the people leaning too heavily on their work. The problem is, there isn’t much else to go on. “The worst benchmark for predicting AGI, except for all the others.”
Fwiw I think the AI village is at least as good of a benchmark for predicting AGI! Of course it’s harder to quantify progress in the village, but it’s very helpful for developing intuitions.