I’ve mostly addressed the concerns in these two comments below, but the short version is that we can do a mixture of handing off control to the AI + giving it the automated bank account, because what matters most here is the ratio between the probability that humans cooperate and the probability of rebellion succeeding, and we can give it the bank account to make the probability of humans cooperating by construction always be greater than or equal to the probability that rebellion succeeds. And this works even under the assumption that you cannot verify the AI’s work and you are in a race with an unknown deadline for any reason, so once the hardest case is disposed of, we can show that it works in all cases (and the reasons why this likely works has already been elaborated on in multiple long comments that I don’t need to repeat myself on.)
I’ve mostly addressed the concerns in these two comments below, but the short version is that we can do a mixture of handing off control to the AI + giving it the automated bank account, because what matters most here is the ratio between the probability that humans cooperate and the probability of rebellion succeeding, and we can give it the bank account to make the probability of humans cooperating by construction always be greater than or equal to the probability that rebellion succeeds. And this works even under the assumption that you cannot verify the AI’s work and you are in a race with an unknown deadline for any reason, so once the hardest case is disposed of, we can show that it works in all cases (and the reasons why this likely works has already been elaborated on in multiple long comments that I don’t need to repeat myself on.)
Comments are below:
Comment 1
Comment 2