Thanks for this comment—it highlights that the post _is_ an attempt in the right direction (model-based learning, rather than pure outcome learning). And that it’s possibly the wrong model (effort level is an insufficient causal factor).
Ah yeah, I didn’t mean to be pointing that out, but that’s an excellent point—“effort” doesn’t necessarily have anything to do with it. You were using “effort” as a handle for whether or not the agent is really trying, which under a perfect rationality assumption (plus an assumption of sufficient knowledge of the situation) would entail employing the best strategy. But in real life conflating effort with credit-worthiness could be a big mistake.
Thanks for this comment—it highlights that the post _is_ an attempt in the right direction (model-based learning, rather than pure outcome learning). And that it’s possibly the wrong model (effort level is an insufficient causal factor).
Ah yeah, I didn’t mean to be pointing that out, but that’s an excellent point—“effort” doesn’t necessarily have anything to do with it. You were using “effort” as a handle for whether or not the agent is really trying, which under a perfect rationality assumption (plus an assumption of sufficient knowledge of the situation) would entail employing the best strategy. But in real life conflating effort with credit-worthiness could be a big mistake.