I think I might be expereriencing goal directed behaviour very differntly on the inside and I am unsure how much of the terminology is supposed to be abstract math concepts and how much of it is supposed to be emotional language. It might be for other people there is a more natural link between being in a low or high utility state and feeling low or high.
The sequence uses emotional language (so far), as it’s written to be widely accessible. I’m extensionally defining what I’m thinking of and how that works for me. These intuitions translated for the 20 or so people I showed the first part of the sequence, but minds are different and it’s possible it doesn’t feel the same for you. As long as the idea of “how well the agent can achieve their goals” makes sense and you see why I’m pointing to these properties, that’s probably fine.
I am also confused what the realtionship between expected utility and attainable utility is supposed to be. If you expect to maximise they should be pretty close.
The sequence uses emotional language (so far), as it’s written to be widely accessible. I’m extensionally defining what I’m thinking of and how that works for me. These intuitions translated for the 20 or so people I showed the first part of the sequence, but minds are different and it’s possible it doesn’t feel the same for you. As long as the idea of “how well the agent can achieve their goals” makes sense and you see why I’m pointing to these properties, that’s probably fine.
Great catch, covered two posts from now.