I agree. The important part of cases 5 & 6, where some other agent “manipulates” Petrov, is that suddenly, to us human readers, it seems like the protagonist of the story (and we do model it as a story) is the cook/kidnapper, not Petrov.
I’m fine with the AI choosing actions using a model of the world that includes me. I’m not fine with it supplanting me from my agent-shaped place in the story I tell about my life.
I agree. The important part of cases 5 & 6, where some other agent “manipulates” Petrov, is that suddenly, to us human readers, it seems like the protagonist of the story (and we do model it as a story) is the cook/kidnapper, not Petrov.
I’m fine with the AI choosing actions using a model of the world that includes me. I’m not fine with it supplanting me from my agent-shaped place in the story I tell about my life.