I would genuinely be surprised if there weren’t ways to at least simplify parts of it.
Like, a mind is able to do multiplication or addition. But any and all algorithms for those kind of operations that we regularly use are much simpler and more reliable than whatever a GPT does for its own primitive math capabilities (which is probably a lot more like a lookup table of known operations). You’d think you could disentangle some functionality into its own modules and make it more reliable that way.
I would genuinely be surprised if there weren’t ways to at least simplify parts of it.
Like, a mind is able to do multiplication or addition. But any and all algorithms for those kind of operations that we regularly use are much simpler and more reliable than whatever a GPT does for its own primitive math capabilities (which is probably a lot more like a lookup table of known operations). You’d think you could disentangle some functionality into its own modules and make it more reliable that way.