This post helped me understand HRAD a lot better. I’m quite confident that subsystems (SS) will be smarter than top-level systems (TS) (because meta-learning will work). So on that it seems we agree. Although, I’m not sure we have the same thing in mind by “smarter” (e.g., I don’t mean that SSs will use some kind of reasoning which is different from model-based RL, just that we won’t be able to easily/tractably identify what algo is being run at the SS level, because: 1. interpretability will be hard and 2. it will be a pile of hacks that won’t have a simple, complete description).
I think this is the main disagreement: I don’t believe that SS will work better because it will stumble upon some low-K
reasoning core; I just think SS will be much better at rapid iterative improvements to AI algos. Actually, it seems possible that, lacking some good TS reasoning, SS will eventually hack itself to death :P.
I’m still a bit put-off by talking about TS vs. SS being “dominant”, and I think there is possibly some difference of views lurking behind this language.
This post helped me understand HRAD a lot better. I’m quite confident that subsystems (SS) will be smarter than top-level systems (TS) (because meta-learning will work). So on that it seems we agree. Although, I’m not sure we have the same thing in mind by “smarter” (e.g., I don’t mean that SSs will use some kind of reasoning which is different from model-based RL, just that we won’t be able to easily/tractably identify what algo is being run at the SS level, because: 1. interpretability will be hard and 2. it will be a pile of hacks that won’t have a simple, complete description).
I think this is the main disagreement: I don’t believe that SS will work better because it will stumble upon some low-K reasoning core; I just think SS will be much better at rapid iterative improvements to AI algos. Actually, it seems possible that, lacking some good TS reasoning, SS will eventually hack itself to death :P.
I’m still a bit put-off by talking about TS vs. SS being “dominant”, and I think there is possibly some difference of views lurking behind this language.