Or the uFAI might just decide to pretend to be Friendly for the whole three or four days it takes to do all the things it needs our help with, and it reading stuff written by us about Friendliness will just make it more convincing. Or it could not bother and just fool us into doing that stuff via easier methods.
Could a chimp give you reasons to self-modify to implement Chimp CEV? What would they be, “if you let lots of us chimps exist, we’ll help you do something you want to do!”
Alice may be unstable to paperclippery, but isn’t out to kill all humans (yet). This obviously won’t help with actively malicious AIs.
And if chimps had all the advantages—my only means of reproduction, say, and also all of the tools and a substantial body of knowledge that it would be annoying to have to replicate, and also I’m bound hand and feet—then that sounds like a pretty good deal. Actually, if they were to offer me that right now, I’d do it freely (though I don’t really have any tasks I’d need them for). I have nothing against chimps.
And if chimps had all the advantages—my only means of reproduction, say, and also all of the tools and a substantial body of knowledge that it would be annoying to have to replicate, and also I’m bound hand and feet—then that sounds like a pretty good deal.
But there’s no reason for you to respect that after you had gotten whatever you need from them, unless that sort of respect is built into you.
Actually, if they were to offer me that right now, I’d do it freely
There’s no reason to believe arbitrary AIs would have a similar cognitive algorithm.
Or the uFAI might just decide to pretend to be Friendly for the whole three or four days it takes to do all the things it needs our help with, and it reading stuff written by us about Friendliness will just make it more convincing. Or it could not bother and just fool us into doing that stuff via easier methods.
Could a chimp give you reasons to self-modify to implement Chimp CEV? What would they be, “if you let lots of us chimps exist, we’ll help you do something you want to do!”
Alice may be unstable to paperclippery, but isn’t out to kill all humans (yet). This obviously won’t help with actively malicious AIs.
And if chimps had all the advantages—my only means of reproduction, say, and also all of the tools and a substantial body of knowledge that it would be annoying to have to replicate, and also I’m bound hand and feet—then that sounds like a pretty good deal. Actually, if they were to offer me that right now, I’d do it freely (though I don’t really have any tasks I’d need them for). I have nothing against chimps.
I have nothing against cows, either. It’s not their fault they’re delicious.
But there’s no reason for you to respect that after you had gotten whatever you need from them, unless that sort of respect is built into you.
There’s no reason to believe arbitrary AIs would have a similar cognitive algorithm.
You did ask about me, specifically…