Interesting article, especially because I’m currently rereading some decision making material in the light of some LLM projects.
I think a very interesting part of your discussed setups is how the world model is defined in detail.
I see it as something that is already involved in our perception with some major restrictions, i.e., incomplete observability and some kind of biological hard-coded guidance system (“feelings”). This view still allows for a factored model, but it comes with different dependencies between the building blocks, i.e., between the values, beliefs, and the decision theory, that have a great impact on the system.
Do you mean with “locally consistent beliefs and values” in your last paragraph not necessarily consistent to every other belief and value the individual has?
The situation you describe in your first paragraph also nicely fits this framework of human decision making outlined in https://www.worldbank.org/en/publication/wdr2015 (highly recommend): > First, people make most judgments and most choices automatically, not deliberatively: we call this “thinking automatically.” > Second, how people act and think often depends on what others around them do and think: we call this “thinking socially.” > Third, individuals in a given society share a common perspective on making sense of the world around them and understanding themselves: we call this “thinking with mental models.” So two other strong „processes“ are at play before a mental model / decision theory can be leveraged (if we share the same definition here that these are the same). So this is much more complex to resolve and we maybe need those corrective actions (due to the restrictions mentioned above)?
This is a very interesting topic and I’m looking forward to more discussions.
Interesting article, especially because I’m currently rereading some decision making material in the light of some LLM projects.
I think a very interesting part of your discussed setups is how the world model is defined in detail.
I see it as something that is already involved in our perception with some major restrictions, i.e., incomplete observability and some kind of biological hard-coded guidance system (“feelings”). This view still allows for a factored model, but it comes with different dependencies between the building blocks, i.e., between the values, beliefs, and the decision theory, that have a great impact on the system.
Do you mean with “locally consistent beliefs and values” in your last paragraph not necessarily consistent to every other belief and value the individual has?
The situation you describe in your first paragraph also nicely fits this framework of human decision making outlined in https://www.worldbank.org/en/publication/wdr2015 (highly recommend):
> First, people make most judgments and most choices automatically, not deliberatively: we call this “thinking automatically.”
> Second, how people act and think often depends on what others around them do and think: we call this “thinking socially.”
> Third, individuals in a given society share a common perspective on making sense of the world around them and understanding themselves: we call this “thinking with mental models.”
So two other strong „processes“ are at play before a mental model / decision theory can be leveraged (if we share the same definition here that these are the same). So this is much more complex to resolve and we maybe need those corrective actions (due to the restrictions mentioned above)?
This is a very interesting topic and I’m looking forward to more discussions.