I would imagine it as the ability to examine a reasonable amount of information on an individual (probably internet activity and possibly video surveillance) and determine what, if anything, you could tell them that would persuade them to do what you want them to. The AI box experiment is probably the canonical example. Exactly how much you could convince how many people to do is debatable; is that what you mean by saying you can’t imagine this?
I misunderstood you, then—what you described I wouldn’t call social manipulation. It’s just figuring out the individual’s pain and pleasure points and then applying the proper amount of pressure to them—nothing social about that.
Whether I can imagine an AI having superpower-level psychological manipulation abilities (but NOT superintelligent at the same time), I’m not sure. On the one hand, you could probably call it a narrow AI, on the other hand it might be that the superpowered ability to manipulate humans does require enough AGI-nature so that the AI is essentially an AGI.
I would imagine it as the ability to examine a reasonable amount of information on an individual (probably internet activity and possibly video surveillance) and determine what, if anything, you could tell them that would persuade them to do what you want them to. The AI box experiment is probably the canonical example. Exactly how much you could convince how many people to do is debatable; is that what you mean by saying you can’t imagine this?
I misunderstood you, then—what you described I wouldn’t call social manipulation. It’s just figuring out the individual’s pain and pleasure points and then applying the proper amount of pressure to them—nothing social about that.
Whether I can imagine an AI having superpower-level psychological manipulation abilities (but NOT superintelligent at the same time), I’m not sure. On the one hand, you could probably call it a narrow AI, on the other hand it might be that the superpowered ability to manipulate humans does require enough AGI-nature so that the AI is essentially an AGI.