I agree that controlling an agent’s values and information are disempowering and restrict freedom. I’m not sure whether there’s a useful distinction. Ultimately they’re both just words that imperfectly capture the important patterns in reality. I think it’s plausible that the right formulation of power involves attending to the agent’s values/sense of import, but my guess is that one must be a little careful to also include counterfactual values in there, else the AI ends up simply optimizing for it’s belief of what you desire. I talk a bit about optimizing for the counterfactual spread of possible values in 3b.
I agree that controlling an agent’s values and information are disempowering and restrict freedom. I’m not sure whether there’s a useful distinction. Ultimately they’re both just words that imperfectly capture the important patterns in reality. I think it’s plausible that the right formulation of power involves attending to the agent’s values/sense of import, but my guess is that one must be a little careful to also include counterfactual values in there, else the AI ends up simply optimizing for it’s belief of what you desire. I talk a bit about optimizing for the counterfactual spread of possible values in 3b.