If two competing companies migrate to the same cloud, they aren’t merging their data, even as they are merging the substrate instantiating the data. Similarly, in principle coalitions don’t need to merge in their values to avoid material conflicts or to maintain high optimization power, they just need to optimize different things. Boundaries of different values don’t need to be breached, both at the level of individuals, and at the level of coalitions (you wouldn’t want to have individuals to also all merge into one). Like in the cloud analogy, this doesn’t prevent coalitions from sharing physical space and resources, and using them efficiently (as a cloud company would) while pursuing discordant purposes (within their own allocations), or shared projects (within allocations for those projects). Thus goodness is about boundaries and coordination, an alignment target for physical infrastructure and governance, but not anyone’s values.
If two competing companies migrate to the same cloud, they aren’t merging their data, even as they are merging the substrate instantiating the data. Similarly, in principle coalitions don’t need to merge in their values to avoid material conflicts or to maintain high optimization power, they just need to optimize different things. Boundaries of different values don’t need to be breached, both at the level of individuals, and at the level of coalitions (you wouldn’t want to have individuals to also all merge into one). Like in the cloud analogy, this doesn’t prevent coalitions from sharing physical space and resources, and using them efficiently (as a cloud company would) while pursuing discordant purposes (within their own allocations), or shared projects (within allocations for those projects). Thus goodness is about boundaries and coordination, an alignment target for physical infrastructure and governance, but not anyone’s values.