Not sure if this is part of the confusion/disagreement, but by “arbitrary” I mean “able to learn ‘anything’” as opposed to “able to learn everything arbitrarily fast/well.” (i.e. instead of systems tailored to learn specific things like we have today, a system that can look at the domains that it might want to learn, choose which of those domains are most strategically relevant, and then learn whichever ones seem highest priority)
(The thing clearly needs to be better than a chimp at general purpose learning, it’s not obvious to me if it needs any particular equivalent IQ for this to start changing the nature of technological progress, but probably needs to be at least equivalent IQ 80 and maybe IQ 100 at least in some domains before it transitions from ‘cute science fair project’ to ‘industry-relevant’)
Not sure if this is part of the confusion/disagreement, but by “arbitrary” I mean “able to learn ‘anything’” as opposed to “able to learn everything arbitrarily fast/well.” (i.e. instead of systems tailored to learn specific things like we have today, a system that can look at the domains that it might want to learn, choose which of those domains are most strategically relevant, and then learn whichever ones seem highest priority)
(The thing clearly needs to be better than a chimp at general purpose learning, it’s not obvious to me if it needs any particular equivalent IQ for this to start changing the nature of technological progress, but probably needs to be at least equivalent IQ 80 and maybe IQ 100 at least in some domains before it transitions from ‘cute science fair project’ to ‘industry-relevant’)