AIs learn slowly now mainly because they know so little.
This seems implausible, because humans learn almost everything we know over our lifetimes, from a starting instruction set smaller than existing pieces of software. If architecture really is overrated (meaning that existing architectures are already good enough) isn’t it more likely that AIs learn so slowly now, simply because the computers aren’t powerful enough yet?
From the article:
This seems implausible, because humans learn almost everything we know over our lifetimes, from a starting instruction set smaller than existing pieces of software. If architecture really is overrated (meaning that existing architectures are already good enough) isn’t it more likely that AIs learn so slowly now, simply because the computers aren’t powerful enough yet?