Interesting read. On co-agency I recommended reading up on some anthropology, especially those concerned with Homo sp. as a social learning species. Our powers come from copy-catting, and maintaining a world in which that is supported by various and any means. Including social institutions of the individual and the group. While the first cyborg was any animal who picked up a lump of something as a tool, the first Homo taught their children quite deliberately in a safe place.
The distinction between auto and actuated highlights this, (as does slavery as flesh-actuator that are not me).
Beyond co-agentic soloware communities I would suggest looking up ‘worlding’ as a verb. That’s the selfing we do in the world among others doing the same.
It results from a drive to world and (pick you favourite worlding outcome) be moral/religious/good/artistic/heroic, for the greater good.
Politics often captures it for a while, an empire and a day. But the world does not care, it survives even as they fade into dust of dusk.
So, what, if not agency? Worlding the self.
So then what is the world? In short it is that ‘extended phenotype’ of kith and kin we live in. The world is the home of all our homes.
https://whyweshould.loofs-samorzewski.com/topics-and-projects/
(worlding as assumed to be something real explores word usage from that POV or framework) https://whyweshould.loofs-samorzewski.com/taphonomy-of-worlding/
alignment (not much LLM AI focussed) https://whyweshould.loofs-samorzewski.com/taphonomy-of-worlding/alignment/
Yes, the economic model of the agent reduces/simplifies just a tad to far and then forgets what sorts of thing emerges from a healthy invisible hand (paucity of vision).
“We don’t really know what human values are”
But we might, or might begin to: I put the effor tin over here :: Alignment ⑥ Values are an effort not a coin https://whyweshould.substack.com/p/alignment-values-are-an-effort-not
or in derived format: If all values are an effort, prices are a meeting of efforts https://whyweshould.substack.com/p/if-all-values-are-an-effort-prices
even deontological positions are an effort, evolution cares about the effort, not the ideal forms