“There exists a place in your cognition that feels like an expectation but actually stores an action plan that your body will follow, and you can load plans into it.” is a valuable insight and I’m not sure I’ve seen it stated quite in that form elsewhere.
Do you have more you could say about how cognition works, or reliable references to point at?
Everything I’ve read is either true but too specific or low level to be useful (on the science end) or mixed with nonsense (on the meditation end), and my own mind is too muddled to easily distinguish true facts about how it works from almost-true facts about how it works. This makes building up a reliable model really hard.
If you can get access to the book, try reading The Intelligent Movement Machine. Basically, motor cortex is not so much about stimulating the contraction of certain muscles, but it’s instead encoding the end-configuration to move the body towards (e.g., motor neurons in monkey motor cortex that encode the act of bringing the hand to the mouth, not matter the starting position of the arm). How the muscles actually achieve this is then more a matter of model-based control theory than RL-trained action policy.
It’s closely related to end-effector control, where the position, orientation, force, speed, etc. of the movement of the end of a robotic appendage are the focus of optimization, as opposed to joint control, which focuses only on the raw motor outputs along the joints of the appendage that cause the movement.
You can also try diving deeper into the active inferenceliterature if you want to build an intuition for how “predictive” circuits can actually drive motor commands. Just remember that Friston comes at this from the perspective of trying to find unifying mathematical formalisms for everything the brain does, both perception and action, which leads him to use terminology for the action side of things that is unintuitive.
Active inference is not saying that the brain “predicts” that the body will achieve a certain configuration and then the universe grants its wish. Instead, just like perception is about predicting what things out in the world are causing your senses to receive the signals that they do, action is about predicting what low-level movements of your body would cause your desired high-level behavior and then using those predictions to actually drive the low-level movements. Or rather, the motor cortex is finding the low-level movements (proprioceptive trajectories) that the agent’s intended behavior would cause and then carrying out those movements. Again, don’t get too hung up on the “prediction” nomenclature; the system does what it does regardless of what you call it.
“There exists a place in your cognition that feels like an expectation but actually stores an action plan that your body will follow, and you can load plans into it.” is a valuable insight and I’m not sure I’ve seen it stated quite in that form elsewhere.
Do you have more you could say about how cognition works, or reliable references to point at?
Everything I’ve read is either true but too specific or low level to be useful (on the science end) or mixed with nonsense (on the meditation end), and my own mind is too muddled to easily distinguish true facts about how it works from almost-true facts about how it works. This makes building up a reliable model really hard.
If you can get access to the book, try reading The Intelligent Movement Machine. Basically, motor cortex is not so much about stimulating the contraction of certain muscles, but it’s instead encoding the end-configuration to move the body towards (e.g., motor neurons in monkey motor cortex that encode the act of bringing the hand to the mouth, not matter the starting position of the arm). How the muscles actually achieve this is then more a matter of model-based control theory than RL-trained action policy.
It’s closely related to end-effector control, where the position, orientation, force, speed, etc. of the movement of the end of a robotic appendage are the focus of optimization, as opposed to joint control, which focuses only on the raw motor outputs along the joints of the appendage that cause the movement.
You can also try diving deeper into the active inference literature if you want to build an intuition for how “predictive” circuits can actually drive motor commands. Just remember that Friston comes at this from the perspective of trying to find unifying mathematical formalisms for everything the brain does, both perception and action, which leads him to use terminology for the action side of things that is unintuitive.
Active inference is not saying that the brain “predicts” that the body will achieve a certain configuration and then the universe grants its wish. Instead, just like perception is about predicting what things out in the world are causing your senses to receive the signals that they do, action is about predicting what low-level movements of your body would cause your desired high-level behavior and then using those predictions to actually drive the low-level movements. Or rather, the motor cortex is finding the low-level movements (proprioceptive trajectories) that the agent’s intended behavior would cause and then carrying out those movements. Again, don’t get too hung up on the “prediction” nomenclature; the system does what it does regardless of what you call it.