It’s completely unclear to me whether he actually thinks there is a risk to humanity from superhuman AI, and if so, what he thinks could or should be done about it.
For example, is he saying that “you will never know that [superhuman AGI] is aligned” truly is “a very deep problem”? Or is he saying that this is a pseudo-problem created by following the zeitgeist or something?
Similarly, what is his point about Darwinism and Machiavellianism? Is he saying, because that’s how the world works, superhuman AI is obviously risky? Or is he saying that these are assumptions that create the illusion of risk??
In any case, Thiel doesn’t seem to have any coherent message about the topic itself (as opposed to disapproving of MIRI and Nick Bostrom). I don’t find that completely surprising. It would be out of character for a politically engaged, technophile entrepreneur to say “humanity’s latest technological adventure is its last, we screwed up and now we’re all doomed”.
His former colleague Elon Musk speaks more clearly—“We are not far from dangerously strong AI” (tweeted four days ago) - and he does have a plan—if you can’t beat them, join them, by wiring up your brain (i.e. Neuralink).
It’s completely unclear to me whether he actually thinks there is a risk to humanity from superhuman AI, and if so, what he thinks could or should be done about it.
For example, is he saying that “you will never know that [superhuman AGI] is aligned” truly is “a very deep problem”? Or is he saying that this is a pseudo-problem created by following the zeitgeist or something?
Similarly, what is his point about Darwinism and Machiavellianism? Is he saying, because that’s how the world works, superhuman AI is obviously risky? Or is he saying that these are assumptions that create the illusion of risk??
In any case, Thiel doesn’t seem to have any coherent message about the topic itself (as opposed to disapproving of MIRI and Nick Bostrom). I don’t find that completely surprising. It would be out of character for a politically engaged, technophile entrepreneur to say “humanity’s latest technological adventure is its last, we screwed up and now we’re all doomed”.
His former colleague Elon Musk speaks more clearly—“We are not far from dangerously strong AI” (tweeted four days ago) - and he does have a plan—if you can’t beat them, join them, by wiring up your brain (i.e. Neuralink).