The interviewer accused Eliezer of being religious-like. But if the universe is deterministically moving from state to state then it’s just like a computer, a machine that moves predictably from state to state. Therefore it’s not religious at all to believe anything in the world (including intelligence) could eventually be reproduced in a computer.
But of course the universe is not like a computer. Everything a computer does until the end of time is implied in it’s initial state, the nature of it’s CPU, and subsequent inputs. It can never deviate from that course. It can never choose like a human, therefore it can never model a human.
And it’s not possible to rationally argue that choice is an illusion because reason uses choice in it’s operations. If you use something in the process of arguing against it, you fall in to absurdity. e.g. your proof comes out something like: “I presumed P, pondered Q and R, chose R, reasoned thusly about R vs S, finally choosing S. Therefore choice isn’t really choosing.”
Nick: “what makes you think the things humans do aren’t implied by its initial state, nature, and inputs?”
What humans do is determined by their nature, just like with a computer. The difference is, human nature is to be able to choose, and computer nature is not.
“The form of choice reason demands (different outputs given different inputs) is perfectly compatible with determinism, in fact it requires determinism, since nondeterministic factors would imply less entanglement between beliefs and reality. If your conclusion is not totally determined by priors and evidence, you’re doing something wrong.”
You’re not doing something wrong, because I don’t think reason is pure discipline, pure modus-ponens. I think it’s more like tempered creativity—utilizing mental actions such as choice, focus, imagination as well as pure logic. The computer just doesn’t have what it takes.
But the point I was making is that the whole idea of reason wouldn’t arise in the first place without prior acceptance of free will. It is only by accepting that we control our minds that the question of how best to do so arises, and ideas like reason, deduction etc. come to be.
All these ideas therefore presuppose free will in their very genesis, and can not validly be used to argue against it. It would be like trying to use the concept “stealing” in a proof against the validity of “property”—there is no such thing as stealing without property. Likewise there is no such thing as reason without free will.