I think if one wants to test general intelligence, one should throw the algorithm at some problem that requires general intelligence. E.g. if it could reach SOTA on text prediction, that’d be impressive. But I think it would very badly fail at even approaching it, and I don’t see any obvious way to improve it.
I suppose it depends how general one is aiming to be. If by general intelligence we mean “able to do what a human can do” then no, at this point the method isn’t up to that standard.
If instead we mean “able to achieve SOTA on a difficult problem which it wasn’t specifically designed to deal with” then PI-MNIST seems like a reasonable starting point.
Also, from a practical standpoint PI-MNIST seems reasonable for a personal research project.
I do think D𝜋′s original post felt like it was overstating it’s case. From a later comment it seems like they more see it as a starting point to add more steps onto to achieve a more general intelligence (i.e. not just a scaling up of the same thing). So instead of paradigms which are MLP + others or DBM + others we would have S(O)NN + others.
I think if one wants to test general intelligence, one should throw the algorithm at some problem that requires general intelligence. E.g. if it could reach SOTA on text prediction, that’d be impressive. But I think it would very badly fail at even approaching it, and I don’t see any obvious way to improve it.
I suppose it depends how general one is aiming to be. If by general intelligence we mean “able to do what a human can do” then no, at this point the method isn’t up to that standard.
If instead we mean “able to achieve SOTA on a difficult problem which it wasn’t specifically designed to deal with” then PI-MNIST seems like a reasonable starting point.
Also, from a practical standpoint PI-MNIST seems reasonable for a personal research project.
I do think D𝜋′s original post felt like it was overstating it’s case. From a later comment it seems like they more see it as a starting point to add more steps onto to achieve a more general intelligence (i.e. not just a scaling up of the same thing). So instead of paradigms which are MLP + others or DBM + others we would have S(O)NN + others.