‘Paternalism’ in this sense would seem more difficult to bring about, more controversial, and harder to control then AGI itself. So then why worry about it?
In the unlikely case mankind becomes capable of realizing beforehand then it wouldn’t serve a purpose by that point as any future AGI will have become an almost trivial problem by comparison. If it was realized afterhand, by presumably super intelligent entities, 2022 human opinions regarding it would just be noise.
At most the process of getting global societal trust to point where it’s possible to realize may be useful to discuss. But that almost certainly would be made harder, rather than easier, by discussing ‘paternalism’ before the trust level has reached that point.
‘Paternalism’ in this sense would seem more difficult to bring about, more controversial, and harder to control then AGI itself. So then why worry about it?
In the unlikely case mankind becomes capable of realizing beforehand then it wouldn’t serve a purpose by that point as any future AGI will have become an almost trivial problem by comparison. If it was realized afterhand, by presumably super intelligent entities, 2022 human opinions regarding it would just be noise.
At most the process of getting global societal trust to point where it’s possible to realize may be useful to discuss. But that almost certainly would be made harder, rather than easier, by discussing ‘paternalism’ before the trust level has reached that point.