If the sufficiently advanced technology is indistinguishable from magic, the arguments about “sufficiently advanced AI system” in absence of actual definition what it is, are indistinguishable from magical thinking.
Ok, then, so the actual problem is that the people who worry about AIs that behave psychopatically have such a capable definition for AI that you consider them basically speaking nonsense?
The “sufficiently advanced” in their argumentations means “sufficiently advanced in the direction of making my argument true” and nothing more.
If I adopt pragmatic version of “advancedness”, then the software (algorithms) that are somehow magically made to* self identify with it’s computing substrate, is less advanced, unless it is also friendly or something.
we don’t know how to do that yet. edit: and some believe that it would just fall out of general smartness somehow, but i’m quite dubious about that.
Ok, then, so the actual problem is that the people who worry about AIs that behave psychopatically have such a capable definition for AI that you consider them basically speaking nonsense?
The “sufficiently advanced” in their argumentations means “sufficiently advanced in the direction of making my argument true” and nothing more.
If I adopt pragmatic version of “advancedness”, then the software (algorithms) that are somehow magically made to* self identify with it’s computing substrate, is less advanced, unless it is also friendly or something.
we don’t know how to do that yet. edit: and some believe that it would just fall out of general smartness somehow, but i’m quite dubious about that.