This problem just looks like the usual question of how much of our resources should be conserved and how much should be used. There is some optimal combination of physical conservation and virtual conservation that leaves enough memory and computronium for other things. We’re always deciding between immediate economic growth and long term access to resources (fossil fuels, clean air, biodiversity, fish). In this case the resource is famous person memorabilia/ human environment. But this isn’t a tricky conceptual issue, just a utility calculation, and the AI will get better at making this calculation the more information it has. The only programming question is how much we value recreating famous people relative to other goods.
I also don’t see how this issue is indicated by the ‘functional definition of a person’ issue.
This problem just looks like the usual question of how much of our resources should be conserved and how much should be used. There is some optimal combination of physical conservation and virtual conservation that leaves enough memory and computronium for other things. We’re always deciding between immediate economic growth and long term access to resources (fossil fuels, clean air, biodiversity, fish). In this case the resource is famous person memorabilia/ human environment. But this isn’t a tricky conceptual issue, just a utility calculation, and the AI will get better at making this calculation the more information it has. The only programming question is how much we value recreating famous people relative to other goods.
I also don’t see how this issue is indicated by the ‘functional definition of a person’ issue.