Let me see if I’ve got this right. So we’ve got these points in some multi-dimensional space, perhaps dimensions like complexity, physicality, intelligence, similarity to existing humans, etc. And you’re asking for a boundary function that defines some of these points as “persons,” and some as “not persons.” Where’s the hard part? I can come up with any function I want. What is it that it’s supposed to match that makes finding the right one so difficult?
Let me see if I’ve got this right. So we’ve got these points in some multi-dimensional space, perhaps dimensions like complexity, physicality, intelligence, similarity to existing humans, etc. And you’re asking for a boundary function that defines some of these points as “persons,” and some as “not persons.” Where’s the hard part? I can come up with any function I want. What is it that it’s supposed to match that makes finding the right one so difficult?
The problem embeds the Hard Problem of Consciousness. If simulated people are just zombies with no qualia, there is no harm in simulating them.
ETA: The other problem is edge cases. Also known to be hard. It’s pretty much chat the abortion and animal rights debates are about.
I assume it’s supposed to match, or at least protect, your own extrapolated preferences.