I wonder if some of the confusion operates like this: the better you understand how insanely dangerous it would be to create a superintelligence, the more you also understand how insanely difficult it is to make a benign one, or even to say what a benign one would be. Those who speak do not know, but those who know cannot speak.
Eliezer has written of the dangers and the difficulty, and that the only near-term strategy is to shut it all down. But I have not seen what steps forward he would take from there.
In the fictional word of dath ilan, as described in planecrash, the guardians of that civilisation have succeeded in shutting it all down, and in a secret establishment called The Basement Of The World are very, very cautiously studying the problem. But we see nothing of their work.
Possible spoiler for planecrash:
Given what the gods of Golarion really are, maybe more is revealed later in the story than I have read up to.
I wonder if some of the confusion operates like this: the better you understand how insanely dangerous it would be to create a superintelligence, the more you also understand how insanely difficult it is to make a benign one, or even to say what a benign one would be. Those who speak do not know, but those who know cannot speak.
Eliezer has written of the dangers and the difficulty, and that the only near-term strategy is to shut it all down. But I have not seen what steps forward he would take from there.
In the fictional word of dath ilan, as described in planecrash, the guardians of that civilisation have succeeded in shutting it all down, and in a secret establishment called The Basement Of The World are very, very cautiously studying the problem. But we see nothing of their work.
Possible spoiler for planecrash:
Given what the gods of Golarion really are, maybe more is revealed later in the story than I have read up to.