Donated $125.
LyleN
Karma: 150
New, Brief Popular-Level Introduction to AI Risks and Superintelligence
Whoops! Thank you.
Recently I was with a group of mathematicians and philosophers. One philosopher asked me whether I believed man was a machine. I replied, “Do you really think it makes any difference?” He most earnestly replied, “Of course! To me it is the most important question in philosophy.”
...I imagine that if my friend finally came to the conclusion that he were a machine, he would be infinitely crestfallen. I think he would think: “My God! How horrible! I am only a machine!” But if I should find out I were a machine, my attitude would be totally different. I would say: “How amazing! I never before realized that machines could be so marvelous!
Raymond Smullyan, This Book Needs No Title, taking joy in the merely real
In some situations you can keep people from fighting the hypothetical by asking a question which explicitly states the point of the hypothetical, instead of asking something vague.
E.g., for Newcomb’s paradox, instead of asking “What do you choose?” (potential answer: “I don’t really need a million dollars, so I’ll just take the box with the $1000″) ask “which choice of box(es) maximizes expected monetary gain?”
E.g., for the Monty Hall problem, instead of asking “Would you switch doors?” (potential answers: “I’d probably just stick with my gut” or “I like goats!”) ask “does switching or not switching maximize your chances of getting the car?”
E.g., for the Prisoner’s Dilemma, instead of “What do you do?” (potential answer: “try to escape!”) ask “Which of the offered choices minimizes expected jail time?”
Additionally, since they are framed in a less personal way, these kinds of questions may be less likely to be perceived as traps or set-ups.
Unfortunately it’s much trickier to apply this strategy to hypotheticals about moral intuition, because usually the purpose of these is to see what considerations the other person in particular attaches to a question like “what do you do?” (E.g., you can’t just ask “which choice maximizes utility?” instead of “what do you do?” in a trolly problem, without circumventing the whole original point of the question). You may still be able to rein in responses by specifically asking something like “would you flip or not flip the lever?”, though.
With the truth, all given facts harmonize; but with what is false, the truth soon hits a wrong note.
-- Aristotle in The Nicomachean Ethics, pointing out entangled truths and contagious lies
Took the survey!
Also, a frequent lurker who has finally made an account!
Robert Charles Wilson, Darwinia