One other aspect I would include is that even figuring out the set of actions available to you can be difficult. This post seems to be arguing that “thinking inside the box” is already hard; I think figuring out how to “think outside the box” is also both important and hard.
That’s very true. I need to think through that more and figure out how to incorporate into my models. I think there’s a lot there which is missing from here.
One other aspect I would include is that even figuring out the set of actions available to you can be difficult. This post seems to be arguing that “thinking inside the box” is already hard; I think figuring out how to “think outside the box” is also both important and hard.
Also, you’ll probably enjoy Research as a Stochastic Decision Process.
That’s very true. I need to think through that more and figure out how to incorporate into my models. I think there’s a lot there which is missing from here.