(a quick experiment: wiggle your index finger for one second. Now wave your whole arm in the air for one second. Now jump up and down for one second. Now roll around on the floor for one second. If you’re like me, you probably did the index finger one, maybe did the arm one, but the thought of getting up and jumping—let alone rolling on the floor—sounded like too much work, so you didn’t. These didn’t actually require different amounts of useful resources from you, like time or money or opportunity cost. But the last two required moving more and bigger muscles, so you were more reluctant to do them. This is what I mean when I say there’s a prior on muscular immobility)
Wow, you got me straight. I did my finger and my arm then stopped.
Though it felt more to me like my reinforcement-learner had strong preferences (i.e. to keep holding my iPad and look at the screen) that overweighed it, than muscular immobility in general having a prior. Often when I’m in the middle of exercise, I feel pretty excited about doing more, or I’ll notice someone doing something and I’ll run over to help. In those situations my reinforcement learner isn’t saying anything like “keep holding the iPad, you like the iPad”.
Wow, you got me straight. I did my finger and my arm then stopped.
Though it felt more to me like my reinforcement-learner had strong preferences (i.e. to keep holding my iPad and look at the screen) that overweighed it, than muscular immobility in general having a prior. Often when I’m in the middle of exercise, I feel pretty excited about doing more, or I’ll notice someone doing something and I’ll run over to help. In those situations my reinforcement learner isn’t saying anything like “keep holding the iPad, you like the iPad”.