Hm, seems like I hadn’t had sth very concrete in mind either, only a feeling that I’d like there to be sth like a concrete example, so I can better follow along with your claims. I was a bit tiered when I read your post, and after considering aspects of it the next day, I found it more useful, and after looking over it now even a bit more useful. So part of my response is “oops my critic was produced by a not great mental process and partly wrong”. Still, here are a few examples where it would have been helpful to have an additional example for what you mean:
To address the first issue, the model would finalize the development of mental primitives. Concepts it can plug in and out of its world-model as needed, dimensions along which it can modify that world-model. One of these primitives will likely be the model’s mesa-objective.
To address the second issue, the model would learn to abstract over compositions of mental primitives: run an algorithm that’d erase the internal complexity of such a composition, leaving only its externally-relevant properties and behaviors.
It would have been nice to have a concrete example for what a mental primitive is and what a “abstract over” means.
If you had one example where you can follow through with all the steps in getting to agency, like maybe an AI learning to play Minecraft, that would have helped me a lot I think.
Hm, seems like I hadn’t had sth very concrete in mind either, only a feeling that I’d like there to be sth like a concrete example, so I can better follow along with your claims. I was a bit tiered when I read your post, and after considering aspects of it the next day, I found it more useful, and after looking over it now even a bit more useful. So part of my response is “oops my critic was produced by a not great mental process and partly wrong”. Still, here are a few examples where it would have been helpful to have an additional example for what you mean:
It would have been nice to have a concrete example for what a mental primitive is and what a “abstract over” means.
If you had one example where you can follow through with all the steps in getting to agency, like maybe an AI learning to play Minecraft, that would have helped me a lot I think.
Right, got it. I’d like to get a more concrete definition for mental primitives as well.