On rereading:
“Hate me if you wish, for I am the one who wants to do this to you.”
This use of the word ‘wants’ struck me as a distinction Eliezer would make, rather than this character.
That then reminded me of how much in-group jargon we use here. Will a paperclipper go foom before we have ems? Are there more than 1000 people that can understand the previous sentence?
Eliezer: I do like being contrarian, but I don’t feel like I’m being contrarian in this. You may give too much credit to our gender. I suspect that if I were not already in a happy monogamous relationship, I wouldn’t have many reservations to this at all. Your description of the verthandi makes her seem like a strict upgrade from Helen, and Stephen’s only objection is that she is not Helen. (Fiction quibble: And couldn’t the AI have obscured that?)
For many men, that’s still a strict upgrade.
And I’ll assume it’s also part of Stephen’s particular optimization that he only got one. Or else you gave us way too much credit.
On rereading: “Hate me if you wish, for I am the one who wants to do this to you.”
This use of the word ‘wants’ struck me as a distinction Eliezer would make, rather than this character. That then reminded me of how much in-group jargon we use here. Will a paperclipper go foom before we have ems? Are there more than 1000 people that can understand the previous sentence?
Eliezer: I do like being contrarian, but I don’t feel like I’m being contrarian in this. You may give too much credit to our gender. I suspect that if I were not already in a happy monogamous relationship, I wouldn’t have many reservations to this at all. Your description of the verthandi makes her seem like a strict upgrade from Helen, and Stephen’s only objection is that she is not Helen. (Fiction quibble: And couldn’t the AI have obscured that?)
For many men, that’s still a strict upgrade.
And I’ll assume it’s also part of Stephen’s particular optimization that he only got one. Or else you gave us way too much credit.
Highly likely to be one of the 107 restrictions; allowing an AI to lie makes it harder to control