If people eventually have relationships with FAI-created humans rather than humans generated by other means, is this a problem?
Depends on what the machine has optimized for. I’m not convinced that many definitions of better friends or lovers are vital optimization goals, or even good ones, in themselves. It’s quite easy to imagine a set of relationships that trigger every desirable stimuli trigger an individual enjoys, complete with short-term difficulties if necessary, but leaves the victim trapped in a situation where his or her preferences remain at a local optima or are otherwise Not Correct by some grander standard.
Interaction with external minds and external situations not built toward you seem like very important parts of jostling folk out from such environments. Better optimization goals might do that, but it’s not an assumption you can easily take.
I’d argue that non-catgirl created beings are people (tautologically), and while relationships with artificially-produced people is fine itself, there are also some possible ethical issues with creating minds optimized for better relationships for certain people, as well, though they’re likely outside the scope of this thread (energy efficiency compared to sorting existing minds, harmful desires, House Elves).
Depends on what the machine has optimized for. I’m not convinced that many definitions of better friends or lovers are vital optimization goals, or even good ones, in themselves. It’s quite easy to imagine a set of relationships that trigger every desirable stimuli trigger an individual enjoys, complete with short-term difficulties if necessary, but leaves the victim trapped in a situation where his or her preferences remain at a local optima or are otherwise Not Correct by some grander standard.
Interaction with external minds and external situations not built toward you seem like very important parts of jostling folk out from such environments. Better optimization goals might do that, but it’s not an assumption you can easily take.
I’d argue that non-catgirl created beings are people (tautologically), and while relationships with artificially-produced people is fine itself, there are also some possible ethical issues with creating minds optimized for better relationships for certain people, as well, though they’re likely outside the scope of this thread (energy efficiency compared to sorting existing minds, harmful desires, House Elves).